00000001:02000400:3.0F:1788580886.023050:0:2995:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing set_hostid 00000001:02000400:3.0:1788580904.085576:0:3215:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1788580906.165290:0:3277:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 411 MB/s 00000001:01000000:0.0:1788580906.415430:0:3277:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 659 MB/s 00000001:01000000:3.0:1788580906.668793:0:3277:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3527 MB/s 00000020:02000000:0.0:1788580907.395570:0:3307:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_g3d8212a 00000400:02000000:0.0:1788580908.358860:0:3322:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.113@tcp [8/256/0/180] 00008000:02000000:1.0F:1788580912.090141:0:3471:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788580965.397068:0:5279:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788580975.545929:0:5857:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788580975.545935:0:5857:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788580975.546076:0:5857:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e3df5fbb 00000080:02000400:0.0:1788580975.546087:0:5857:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788580975.550499:0:5857:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788580975.550512:0:5857:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788580975.550569:0:5857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000bd077976) 00000020:00000080:0.0:1788580975.550598:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788580975.565425:0:5857:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788580975.565859:0:5857:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788580975.586137:0:5857:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788580975.586175:0:5857:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788580975.586194:0:5857:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788580975.586355:0:5857:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788580975.586389:0:5857:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788580975.586862:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788580975.586871:0:5857:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788580975.586883:0:5857:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf54e3944c2a6fc97 00000020:01000004:3.0:1788580975.586891:0:5857:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788580975.586895:0:5857:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788580975.586900:0:5857:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e3df5fbb from MGS 00000020:01000004:3.0:1788580975.586905:0:5857:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788580975.586935:0:5857:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000678f867f) 00000020:00000080:3.0:1788580975.586946:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788580975.587092:0:5857:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e3df5fbb from MGS, refs=2 00080000:01000000:3.0:1788580975.587098:0:5857:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788580975.587103:0:5857:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf54e3944c2a6fca5 00000100:00100000:3.0:1788580975.587203:0:5857:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788580975.587369:0:5857:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788580975.587375:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788580975.588092:0:5857:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788580975.588107:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788580975.588963:0:5857:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788580975.589219:0:5857:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788580975.589225:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788580975.589870:0:5857:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788580975.589877:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788580975.590358:0:5857:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788580975.590365:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788580975.591152:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788580975.591156:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788580975.591158:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788580975.591457:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788580975.591460:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788580975.591462:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788580975.592363:0:5857:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788580975.596093:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0F:1788580975.851615:0:5857:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2688 MB/s 00000001:01000000:1.0:1788580976.105220:0:5857:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2826 MB/s 00000001:01000000:1.0:1788580976.358946:0:5857:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 442 MB/s 00000001:01000000:2.0:1788580976.609729:0:5857:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 760 MB/s 00080000:10000000:2.0:1788580976.617103:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1788580976.624842:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788580976.640209:0:5857:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788580976.640224:0:5857:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788580976.640227:0:5857:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788580976.643962:0:5867:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788580976.644045:0:5857:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788580976.644128:0:5857:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788580976.644399:0:5857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788580976.644427:0:5857:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788580976.644800:0:5857:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788580976.644985:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788580976.644992:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788580976.646750:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788580976.646761:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788580976.648605:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788580976.648618:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788580976.649730:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788580976.649752:0:5857:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.113@tcp' 00000020:01000004:3.0:1788580976.649754:0:5857:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788580976.649806:0:5857:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.113@tcp (typ=mgc) 00000020:00000080:3.0:1788580976.649818:0:5857:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.113@tcp (000000001f72ade9) 00000020:00000080:3.0:1788580976.649837:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788580976.649921:0:5857:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a679c1ab@MGC192.168.201.113@tcp: add connection 192.168.201.113@tcp at head 00010000:00010000:3.0:1788580976.650100:0:5857:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.113@tcp-0 is initialized 00000040:01000000:3.0:1788580976.650107:0:5857:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.113@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788580976.652434:0:5874:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788580976.652685:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.113@tcp (uuid 9ba618d3-9e87-4bcf-a8a7-2c9428d45189) 00000020:00000080:2.0:1788580976.652787:0:5857:0:(genops.c:1385:class_connect()) connect: client 9ba618d3-9e87-4bcf-a8a7-2c9428d45189, cookie 0xf54e3944c2a6fcb3 00000100:00080000:2.0:1788580976.652800:0:5857:0:(import.c:510:import_select_connection()) MGC192.168.201.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788580976.652805:0:5857:0:(import.c:624:import_select_connection()) MGC192.168.201.113@tcp: import 00000000a679c1ab using connection 192.168.201.113@tcp/0@lo 00000100:00100000:2.0:1788580976.652857:0:5857:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000032d185c3 x1875463014187136/t0(0) o250->MGC192.168.201.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788580976.652884:0:5857:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 9ba618d3-9e87-4bcf-a8a7-2c9428d45189->MGS 00000020:01000004:2.0:1788580976.652902:0:5857:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788580976.652907:0:5857:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788580976.652927:0:5857:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000065f43dca) 00000020:00000080:2.0:1788580976.652939:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788580976.653883:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032d185c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3337:1875463014187136:0@lo:250: 00000100:00100000:1.0:1788580976.653970:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580976.655225:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014187136 00000100:00100000:3.0:1788580976.655235:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014187136 00000100:00080000:0.0:1788580976.655893:0:5872:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1788580976.656042:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788580976.656050:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053b21c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3337:x1875463014187136:12345-0@lo:250: 00010000:00080000:3.0:1788580976.656086:0:5869:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9ba618d3-9e87-4bcf-a8a7-2c9428d45189@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:3.0:1788580976.656196:0:5869:0:(genops.c:1385:class_connect()) connect: client 9ba618d3-9e87-4bcf-a8a7-2c9428d45189, cookie 0xf54e3944c2a6fcc1 00000100:00080000:3.0:1788580976.657227:0:5869:0:(import.c:65:import_set_state_nolock()) 00000000cc3cdddd : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788580976.666203:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053b21c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+5:3337:x1875463014187136:12345-0@lo:250: Request processed in 10147us (12228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580976.666229:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788580976.666919:0:3337:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788580976.666933:0:3337:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.113@tcp: connect to target with instance 0 00000100:00080000:1.0:1788580976.666943:0:3337:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788580976.666949:0:3337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788580976.666953:0:3337:0:(import.c:65:import_set_state_nolock()) 00000000a679c1ab MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788580976.666955:0:3337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788580976.666963:0:3337:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788580976.666970:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032d185c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3337:1875463014187136:0@lo:250: 00000100:00100000:2.0:1788580976.672122:0:5857:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788580976.672369:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788580976.672375:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788580976.678208:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788580976.678222:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788580976.678891:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788580976.678898:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788580976.680481:0:5857:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788580976.680684:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788580976.680689:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788580976.681636:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788580976.681646:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788580976.721639:0:5857:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788580976.721880:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788580976.721888:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788580976.723463:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788580976.723474:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788580976.724506:0:5857:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788580976.724718:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788580976.724724:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788580976.725636:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788580976.725645:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788580976.726379:0:5857:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788580976.726664:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788580976.726669:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788580976.727384:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788580976.727464:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788580976.728351:0:5857:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788580976.728614:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788580976.728619:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788580976.729236:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788580976.729514:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788580976.766918:0:5857:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788580976.767698:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788580976.767706:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788580976.771902:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788580976.771918:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788580976.774816:0:5857:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788580976.774834:0:5857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788580976.776560:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788580976.776591:0:5857:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788580976.776598:0:5857:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788580976.776746:0:5857:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.113@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788580976.776780:0:5857:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.113@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788580976.776785:0:5857:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788580976.776787:0:5857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788580976.776788:0:5857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788580976.776789:0:5857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788580976.776790:0:5857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788580976.776791:0:5857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788580976.776793:0:5857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788580976.776794:0:5857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788580976.776796:0:5857:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788580976.776797:0:5857:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788580976.776802:0:5857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788580976.776803:0:5857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788580976.776806:0:5857:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788580976.776808:0:5857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788580976.776809:0:5857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788580976.776810:0:5857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788580976.776811:0:5857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788580976.776812:0:5857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788580976.776813:0:5857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788580976.776814:0:5857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788580976.776815:0:5857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788580976.776815:0:5857:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788580976.776816:0:5857:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788580976.776817:0:5857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788580976.776818:0:5857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788580976.776852:0:5857:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788580976.776869:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027167568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014187264:0@lo:253: 00000100:00100000:0.0:1788580976.776947:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580976.777072:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ad7d024 going to sleep for 11 seconds 00000100:00100000:2.0:1788580976.777188:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014187264 00000100:00100000:2.0:1788580976.777196:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014187264 00000100:00100000:2.0:1788580976.777266:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788580976.777276:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041287061 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+5:5857:x1875463014187264:12345-0@lo:253: 20000000:01000000:2.0:1788580976.777328:0:5871:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788580976.777332:0:5871:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788580976.778657:0:5892:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788580976.778729:0:5871:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788580976.779360:0:5871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788580976.785055:0:5893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788580976.785619:0:5871:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788580976.785624:0:5871:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788580976.785630:0:5871:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788580976.785633:0:5871:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788580976.785649:0:5871:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788580976.786070:0:5871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788580976.786673:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788580976.786688:0:5871:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788580976.786737:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788580976.786783:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788580976.786819:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788580976.786918:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788580976.786926:0:5871:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788580976.787049:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788580976.787058:0:5871:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788580976.787170:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788580976.787179:0:5871:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788580976.787213:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788580976.787582:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788580976.787618:0:5871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788580976.787623:0:5871:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788580976.787636:0:5871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788580976.787870:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788580976.787881:0:5871:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788580976.787924:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788580976.788034:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788580976.788178:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788580976.788190:0:5871:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788580976.788493:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788580976.788503:0:5871:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788580976.788571:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788580976.788611:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788580976.788646:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788580976.788657:0:5871:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788580976.788747:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788580976.788756:0:5871:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788580976.788787:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788580976.788821:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788580976.789083:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788580976.789218:0:5871:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788580976.789226:0:5871:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788580976.790071:0:5894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788580976.790711:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788580976.790742:0:5871:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.113@tcp for mdt 20000000:01000000:2.0:1788580976.790744:0:5871:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.113@tcp (null) (null) (null) 00000040:00080000:2.0:1788580976.790782:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788580976.790790:0:5871:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788580976.790822:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788580976.790830:0:5871:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.113@tcp (null) (null) 00000040:00080000:2.0:1788580976.790877:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788580976.790888:0:5871:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788580976.790921:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788580976.790972:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788580976.791031:0:5871:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788580976.791035:0:5871:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788580976.791041:0:5871:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788580976.791048:0:5871:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788580976.791722:0:5895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1788580976.791832:0:5871:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788580976.803007:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788580976.803061:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1788580976.803272:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1788580976.803293:0:5871:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788580976.803296:0:5871:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788580976.803299:0:5871:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788580976.803314:0:5871:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788580976.803316:0:5871:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788580976.803350:0:5871:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788580976.803353:0:5871:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788580976.804336:0:5896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788580976.805006:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788580976.805054:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788580976.805303:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1788580976.805319:0:5871:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788580976.805321:0:5871:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788580976.805985:0:5897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1788580976.806522:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1788580976.806845:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1788580976.806945:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:2.0:1788580976.807365:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788580976.807368:0:5871:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1788580976.807377:0:5871:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788580976.807535:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004ea5b7cd/0xf54e3944c2a6fcc8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580976.807562:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ea5b7cd/0xf54e3944c2a6fcc8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580976.807571:0:5871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004ea5b7cd/0xf54e3944c2a6fcc8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580976.807576:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004ea5b7cd/0xf54e3944c2a6fcc8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580976.807582:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004ea5b7cd/0xf54e3944c2a6fcc8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580976.807589:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004ea5b7cd/0xf54e3944c2a6fcc8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580976.807594:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004ea5b7cd already unused, calling callback (000000009cb1ff49) 00010000:00010000:2.0:1788580976.807597:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004ea5b7cd/0xf54e3944c2a6fcc8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580976.807616:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004ea5b7cd/0xf54e3944c2a6fcc8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580976.807629:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004ea5b7cd/0xf54e3944c2a6fcc8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580976.807636:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004ea5b7cd/0xf54e3944c2a6fcc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580976.807641:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004ea5b7cd/0xf54e3944c2a6fcc8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788580976.807658:0:5871:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788580977.102797:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041287061 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+5:5857:x1875463014187264:12345-0@lo:253: Request processed in 325516us (325843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580977.102811:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788580977.102922:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027167568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014187264:0@lo:253: 10000000:01000000:0.0:1788580977.102939:0:5857:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788580977.102942:0:5857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788580977.102955:0:5857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788580977.102956:0:5857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788580977.102957:0:5857:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788580977.102958:0:5857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788580977.102959:0:5857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788580977.102960:0:5857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788580977.102962:0:5857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788580977.102963:0:5857:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788580977.102964:0:5857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788580977.102965:0:5857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788580977.102984:0:5857:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e3df5fbb from lustre-MDT0000 10000000:01000000:0.0:1788580977.103012:0:5857:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788580977.103015:0:5857:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788580977.103019:0:5857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff919047dccd28 10000000:01000000:0.0:1788580977.103023:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788580977.103046:0:5857:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff919047dccd28 from 1 10000000:01000000:0.0:1788580977.103049:0:5857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788580977.103085:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 000000009cf11309/0xf54e3944c2a6fccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580977.103095:0:5857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 000000009cf11309/0xf54e3944c2a6fccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580977.103103:0:5857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 000000009cf11309/0xf54e3944c2a6fccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788580977.103118:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027167568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014187392:0@lo:101: 00000100:00100000:0.0:1788580977.103166:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580977.103234:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f5ba08f9 going to sleep for 11 seconds 00000100:00100000:3.0:1788580977.103490:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014187392 00000100:00100000:3.0:1788580977.103497:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014187392 00000100:00100000:3.0:1788580977.103556:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788580977.103564:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3af31ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+5:5857:x1875463014187392:12345-0@lo:101: 00010000:00010000:3.0:1788580977.103576:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788580977.103589:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aa42ed1e/0xf54e3944c2a6fcd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fccf expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.103611:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aa42ed1e/0xf54e3944c2a6fcd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fccf expref: 6 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.103619:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aa42ed1e/0xf54e3944c2a6fcd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fccf expref: 6 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.103626:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aa42ed1e, rc 0) 00000100:00100000:3.0:1788580977.103660:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3af31ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+6:5857:x1875463014187392:12345-0@lo:101: Request processed in 98us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580977.103665:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788580977.103751:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027167568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014187392:0@lo:101: 00010000:00010000:2.0:1788580977.103765:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 000000009cf11309/0xf54e3944c2a6fccf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fcd6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580977.103772:0:5857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 000000009cf11309/0xf54e3944c2a6fccf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fcd6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788580977.103816:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000df0b437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014187520:0@lo:501: 00000100:00100000:2.0:1788580977.103840:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580977.103868:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085313440 going to sleep for 11 seconds 00000100:00100000:3.0:1788580977.103922:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014187520 00000100:00100000:3.0:1788580977.103926:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014187520 00000100:00100000:3.0:1788580977.103960:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788580977.103966:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001725429a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+6:5857:x1875463014187520:12345-0@lo:501: 00000100:00100000:3.0:1788580977.104181:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001725429a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+6:5857:x1875463014187520:12345-0@lo:501: Request processed in 215us (339us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788580977.104189:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788580977.104389:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000df0b437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014187520:0@lo:501: 10000000:01000000:2.0:1788580977.104414:0:5857:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788580977.104432:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 000000009cf11309/0xf54e3944c2a6fccf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fcd6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580977.104454:0:5857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: 000000009cf11309/0xf54e3944c2a6fccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fcd6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788580977.104462:0:5857:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91904733b800 10000000:01000000:2.0:1788580977.104466:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788580977.104469:0:5857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91904733b800 10000000:01000000:2.0:1788580977.104471:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788580977.104474:0:5857:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91904733b800 from 1 10000000:01000000:2.0:1788580977.104476:0:5857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788580977.104495:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 000000004ea5b7cd/0xf54e3944c2a6fcdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580977.104501:0:5857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 000000004ea5b7cd/0xf54e3944c2a6fcdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580977.104508:0:5857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 000000004ea5b7cd/0xf54e3944c2a6fcdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788580977.104520:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000df0b437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014187648:0@lo:101: 00000100:00100000:2.0:1788580977.104561:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580977.104581:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085313440 going to sleep for 11 seconds 00000100:00100000:3.0:1788580977.104703:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014187648 00000100:00100000:3.0:1788580977.104708:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014187648 00000100:00100000:3.0:1788580977.104740:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788580977.104746:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1cac1ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+6:5857:x1875463014187648:12345-0@lo:101: 00010000:00010000:3.0:1788580977.104754:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788580977.104763:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000100ee921/0xf54e3944c2a6fce4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fcdd expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.104777:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000100ee921/0xf54e3944c2a6fce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fcdd expref: 7 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.104785:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000100ee921/0xf54e3944c2a6fce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fcdd expref: 7 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.104792:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000100ee921, rc 0) 00000100:00100000:3.0:1788580977.104818:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1cac1ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+7:5857:x1875463014187648:12345-0@lo:101: Request processed in 73us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580977.104825:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788580977.104959:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000df0b437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014187648:0@lo:101: 00010000:00010000:2.0:1788580977.104969:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 000000004ea5b7cd/0xf54e3944c2a6fcdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fce4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580977.104976:0:5857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 000000004ea5b7cd/0xf54e3944c2a6fcdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fce4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788580977.104999:0:5857:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788580977.105012:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 000000004ea5b7cd/0xf54e3944c2a6fcdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fce4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580977.105018:0:5857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: 000000004ea5b7cd/0xf54e3944c2a6fcdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fce4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788580977.105023:0:5857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788580977.105026:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788580977.105030:0:5857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91904733b800 10000000:01000000:2.0:1788580977.105032:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788580977.105035:0:5857:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788580977.105037:0:5857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788580977.105049:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 00000000a80d6376/0xf54e3944c2a6fceb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580977.105055:0:5857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 00000000a80d6376/0xf54e3944c2a6fceb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580977.105061:0:5857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 00000000a80d6376/0xf54e3944c2a6fceb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788580977.105072:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000df0b437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014187776:0@lo:101: 00000100:00100000:2.0:1788580977.105098:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580977.105120:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085313440 going to sleep for 11 seconds 00000100:00100000:0.0:1788580977.105214:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014187776 00000100:00100000:0.0:1788580977.105219:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014187776 00000100:00100000:0.0:1788580977.105288:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788580977.105294:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d56e6aca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+7:5857:x1875463014187776:12345-0@lo:101: 00010000:00010000:0.0:1788580977.105301:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788580977.105308:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007015917f/0xf54e3944c2a6fcf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fceb expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580977.105321:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007015917f/0xf54e3944c2a6fcf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fceb expref: 8 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580977.105328:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007015917f/0xf54e3944c2a6fcf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fceb expref: 8 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580977.105334:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007015917f, rc 0) 00000100:00100000:0.0:1788580977.105372:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d56e6aca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+8:5857:x1875463014187776:12345-0@lo:101: Request processed in 78us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580977.105555:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788580977.105637:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000df0b437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014187776:0@lo:101: 00010000:00010000:2.0:1788580977.105647:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 00000000a80d6376/0xf54e3944c2a6fceb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fcf2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580977.105664:0:5857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 00000000a80d6376/0xf54e3944c2a6fceb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fcf2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788580977.105707:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000df0b437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014187904:0@lo:501: 00000100:00100000:2.0:1788580977.105732:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580977.105762:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085313440 going to sleep for 11 seconds 00000100:00100000:3.0:1788580977.105814:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014187904 00000100:00100000:3.0:1788580977.105819:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014187904 00000100:00100000:3.0:1788580977.105849:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788580977.105856:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddded71f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+8:5857:x1875463014187904:12345-0@lo:501: 00000100:00100000:3.0:1788580977.106078:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddded71f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+9:5857:x1875463014187904:12345-0@lo:501: Request processed in 222us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580977.106085:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788580977.106205:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000df0b437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014187904:0@lo:501: 00000100:00100000:2.0:1788580977.106231:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000df0b437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014188032:0@lo:503: 00000100:00100000:3.0:1788580977.106631:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580977.106662:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085313440 going to sleep for 11 seconds 00000100:00100000:0.0:1788580977.106718:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014188032 00000100:00100000:0.0:1788580977.106723:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014188032 00000100:00100000:0.0:1788580977.106757:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788580977.106764:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087c536f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+9:5857:x1875463014188032:12345-0@lo:503: 00000100:00100000:0.0:1788580977.106929:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087c536f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+9:5857:x1875463014188032:12345-0@lo:503: Request processed in 166us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580977.106936:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788580977.107116:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000df0b437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014188032:0@lo:503: 00000100:00100000:2.0:1788580977.107682:0:5900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000df0b437 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5900:1875463014188160:0@lo:502: 00000100:00100000:2.0:1788580977.107731:0:5900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580977.107810:0:5900:0:(client.c:2715:ptlrpc_set_wait()) set 000000003fffbac7 going to sleep for 11 seconds 00000100:00100000:0.0:1788580977.108039:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014188160 00000100:00100000:0.0:1788580977.108046:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014188160 00000100:00100000:0.0:1788580977.108118:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788580977.108126:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d08de97d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+9:5900:x1875463014188160:12345-0@lo:502: 00000100:00100000:2.0:1788580977.108614:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d08de97d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+9:5900:x1875463014188160:12345-0@lo:502: Request processed in 488us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580977.108623:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788580977.108701:0:5900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000df0b437 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5900:1875463014188160:0@lo:502: 00000020:01000000:0.0:1788580977.108727:0:5900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788580977.108737:0:5900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788580977.108740:0:5900:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788580977.108745:0:5900:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788580977.108748:0:5900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788580977.108762:0:5900:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ec512d03) 00000020:00000080:0.0:1788580977.108787:0:5900:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788580977.108807:0:5900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788580977.108890:0:5900:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788580977.108898:0:5900:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf54e3944c2a6fd00 00000020:00000080:0.0:1788580977.109145:0:5900:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788580977.109149:0:5900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788580977.109153:0:5900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788580977.109154:0:5900:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788580977.109157:0:5900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788580977.109168:0:5900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788580977.109170:0:5900:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788580977.109174:0:5900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788580977.109181:0:5900:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000003b872bfc) 00000020:00000080:0.0:1788580977.109190:0:5900:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788580977.109193:0:5900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788580977.109196:0:5900:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788580977.109198:0:5900:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788580977.109204:0:5900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788580977.109295:0:5900:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e3df5fbb from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788580977.109308:0:5900:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a5dde514) 00000020:00000080:0.0:1788580977.109316:0:5900:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788580977.109367:0:5900:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788580977.109373:0:5900:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf54e3944c2a6fd15 00000020:00000080:0.0:1788580977.109606:0:5900:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788580977.109613:0:5900:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788580977.109618:0:5900:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf54e3944c2a6fd1c 00080000:01000000:0.0:1788580977.109623:0:5900:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788580977.109626:0:5900:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf54e3944c2a6fd23 00080000:10000000:0.0:1788580977.110019:0:5900:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1788580977.110221:0:5900:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788580977.115672:0:5900:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788580977.203038:0:5900:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788580977.203659:0:5900:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788580977.206622:0:5900:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788580977.206911:0:5900:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788580977.246033:0:5900:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000002bf2cce7) 00000020:00000080:3.0:1788580977.246070:0:5900:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788580977.246139:0:5900:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788580977.246145:0:5900:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf54e3944c2a6fd31 00000020:00000080:2.0:1788580977.247100:0:5900:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788580977.252832:0:5900:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788580977.306054:0:5900:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788580977.343892:0:5900:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788580977.373545:0:5900:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788580977.420841:0:5900:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788580977.468219:0:5900:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788580977.507005:0:5900:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf54e3944c2a6fd38 00000020:00000080:2.0:1788580977.508271:0:5900:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788580977.508285:0:5900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788580977.508294:0:5900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788580977.508296:0:5900:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788580977.508309:0:5900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788580977.508315:0:5900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788580977.508317:0:5900:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788580977.508321:0:5900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788580977.508365:0:5900:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788580977.508462:0:5900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788580977.508466:0:5900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788580977.508468:0:5900:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788580977.508471:0:5900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788580977.508473:0:5900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788580977.508474:0:5900:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788580977.508477:0:5900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788580977.508478:0:5900:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788580977.508534:0:5900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000897ee47b pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5900:1875463014188288:0@lo:502: 00000100:00100000:2.0:1788580977.508617:0:5900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580977.508741:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014188288 00000100:00100000:3.0:1788580977.508749:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014188288 00000100:00100000:3.0:1788580977.508786:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788580977.508794:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000623db8c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+9:5900:x1875463014188288:12345-0@lo:502: 00000100:00100000:3.0:1788580977.509178:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000623db8c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+9:5900:x1875463014188288:12345-0@lo:502: Request processed in 383us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580977.509186:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788580977.509297:0:5900:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5602be3 going to sleep for 11 seconds 00000100:00100000:2.0:1788580977.509320:0:5900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000897ee47b pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5900:1875463014188288:0@lo:502: 00000020:01000000:2.0:1788580977.509344:0:5900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788580977.509349:0:5900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788580977.509351:0:5900:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788580977.509354:0:5900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788580977.509682:0:5857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788580977.509701:0:5857:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788580977.509723:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 00000000a80d6376/0xf54e3944c2a6fceb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fcf2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.509733:0:5857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: 00000000a80d6376/0xf54e3944c2a6fceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fcf2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788580977.509740:0:5857:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91904733b800 from 1 10000000:01000000:3.0:1788580977.509744:0:5857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788580977.509788:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 00000000dd7fc8b9/0xf54e3944c2a6fd3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.509797:0:5857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 00000000dd7fc8b9/0xf54e3944c2a6fd3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.509815:0:5857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 00000000dd7fc8b9/0xf54e3944c2a6fd3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788580977.509830:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001846af4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014188416:0@lo:101: 00000100:00100000:3.0:1788580977.509866:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580977.510060:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014188416 00000100:00100000:0.0:1788580977.510066:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014188416 00000100:00100000:0.0:1788580977.510107:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788580977.510114:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000890dff7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+9:5857:x1875463014188416:12345-0@lo:101: 00010000:00010000:0.0:1788580977.510124:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788580977.510137:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008a2fe7e3/0xf54e3944c2a6fd46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fd3f expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580977.510157:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a2fe7e3/0xf54e3944c2a6fd46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fd3f expref: 10 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580977.510178:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008a2fe7e3/0xf54e3944c2a6fd46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fd3f expref: 10 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580977.510186:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008a2fe7e3, rc 0) 00000100:00100000:0.0:1788580977.510228:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000890dff7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+10:5857:x1875463014188416:12345-0@lo:101: Request processed in 115us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580977.510234:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788580977.510768:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ef052e27 going to sleep for 11 seconds 00000100:00100000:3.0:1788580977.510789:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001846af4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014188416:0@lo:101: 00010000:00010000:3.0:1788580977.510802:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 00000000dd7fc8b9/0xf54e3944c2a6fd3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fd46 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.510810:0:5857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 00000000dd7fc8b9/0xf54e3944c2a6fd3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fd46 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788580977.511831:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001846af4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014188544:0@lo:256: 00000100:00100000:3.0:1788580977.511896:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580977.511924:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ef052e27 going to sleep for 11 seconds 00000100:00100000:0.0:1788580977.512058:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014188544 00000100:00100000:0.0:1788580977.512066:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014188544 00000100:00100000:0.0:1788580977.512114:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788580977.512123:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9a6efff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+10:5857:x1875463014188544:12345-0@lo:256: 20000000:01000000:0.0:1788580977.512141:0:5871:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788580977.512148:0:5871:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788580977.512236:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9a6efff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+10:5857:x1875463014188544:12345-0@lo:256: Request processed in 114us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580977.512267:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788580977.512369:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001846af4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014188544:0@lo:256: 10000000:01000000:2.0:1788580977.513231:0:5857:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788580977.513324:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 00000000dd7fc8b9/0xf54e3944c2a6fd3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fd46 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580977.513336:0:5857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: 00000000dd7fc8b9/0xf54e3944c2a6fd3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fd46 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788580977.513345:0:5857:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91904733b800 from 1 10000000:01000000:2.0:1788580977.513360:0:5857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788580977.513402:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 000000004838b099/0xf54e3944c2a6fd4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580977.513410:0:5857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 000000004838b099/0xf54e3944c2a6fd4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580977.513418:0:5857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 000000004838b099/0xf54e3944c2a6fd4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788580977.513434:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000897ee47b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014188672:0@lo:101: 00000100:00100000:2.0:1788580977.513481:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580977.513514:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5602be3 going to sleep for 11 seconds 00000100:00100000:2.0:1788580977.513543:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014188672 00000100:00100000:2.0:1788580977.513549:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014188672 00000100:00100000:2.0:1788580977.513581:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788580977.513588:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035757808 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+10:5857:x1875463014188672:12345-0@lo:101: 00010000:00010000:2.0:1788580977.513599:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788580977.513612:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000067fed1a3/0xf54e3944c2a6fd54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fd4d expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580977.513631:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000067fed1a3/0xf54e3944c2a6fd54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fd4d expref: 11 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580977.513641:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000067fed1a3/0xf54e3944c2a6fd54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fd4d expref: 11 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580977.513649:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000067fed1a3, rc 0) 00000100:00100000:2.0:1788580977.513680:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035757808 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:5857:x1875463014188672:12345-0@lo:101: Request processed in 93us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580977.513696:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788580977.513732:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000897ee47b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014188672:0@lo:101: 00010000:00010000:2.0:1788580977.513743:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 000000004838b099/0xf54e3944c2a6fd4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fd54 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580977.513751:0:5857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 000000004838b099/0xf54e3944c2a6fd4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fd54 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788580977.513799:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000897ee47b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014188800:0@lo:501: 00000100:00100000:2.0:1788580977.513821:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580977.513832:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5602be3 going to sleep for 11 seconds 00000100:00100000:2.0:1788580977.513844:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014188800 00000100:00100000:2.0:1788580977.513847:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014188800 00000100:00100000:2.0:1788580977.513864:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788580977.513868:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1eed4b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:5857:x1875463014188800:12345-0@lo:501: 00000100:00100000:2.0:1788580977.514787:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1eed4b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:5857:x1875463014188800:12345-0@lo:501: Request processed in 916us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580977.514797:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788580977.515520:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000897ee47b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014188800:0@lo:501: 00000100:00100000:2.0:1788580977.515661:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000897ee47b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014188928:0@lo:503: 00000100:00100000:2.0:1788580977.515714:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580977.515785:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 000000003fffbac7 going to sleep for 11 seconds 00000100:00100000:3.0:1788580977.515821:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014188928 00000100:00100000:3.0:1788580977.515828:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014188928 00000100:00100000:3.0:1788580977.515909:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788580977.515918:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d700f915 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:5857:x1875463014188928:12345-0@lo:503: 00000040:00080000:3.0:1788580977.515971:0:5869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788580977.516018:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d700f915 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:5857:x1875463014188928:12345-0@lo:503: Request processed in 102us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580977.516026:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788580977.516093:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000897ee47b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014188928:0@lo:503: 00000040:00080000:2.0:1788580977.517056:0:5905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788580977.517279:0:5857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788580977.517308:0:5857:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788580977.517326:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 000000004838b099/0xf54e3944c2a6fd4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fd54 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580977.517338:0:5857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: 000000004838b099/0xf54e3944c2a6fd4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fd54 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788580977.517393:0:5857:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788580977.517396:0:5857:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91904733b800 10000000:01000000:1.0:1788580977.517399:0:5857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91904733b800 10000000:01000000:1.0:1788580977.517402:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788580977.517407:0:5857:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91904733b800 from 1 10000000:01000000:1.0:1788580977.517409:0:5857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788580977.517447:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 0000000052fbe606/0xf54e3944c2a6fd5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580977.517454:0:5857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 0000000052fbe606/0xf54e3944c2a6fd5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580977.517462:0:5857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 0000000052fbe606/0xf54e3944c2a6fd5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788580977.517478:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b71ff1fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014189056:0@lo:101: 00000100:00100000:1.0:1788580977.517523:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580977.519079:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 000000009954eae5 going to sleep for 11 seconds 00000100:00100000:0.0:1788580977.519198:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014189056 00000100:00100000:0.0:1788580977.519209:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014189056 00000100:00100000:0.0:1788580977.519277:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788580977.519286:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d02edb84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:5857:x1875463014189056:12345-0@lo:101: 00010000:00010000:0.0:1788580977.519302:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788580977.519317:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000013ffadeb/0xf54e3944c2a6fd62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fd5b expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580977.519341:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000013ffadeb/0xf54e3944c2a6fd62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fd5b expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580977.519350:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000013ffadeb/0xf54e3944c2a6fd62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fd5b expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580977.519382:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000013ffadeb, rc 0) 00000100:00100000:0.0:1788580977.519450:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d02edb84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5857:x1875463014189056:12345-0@lo:101: Request processed in 165us (1927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580977.519457:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788580977.519611:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b71ff1fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014189056:0@lo:101: 00010000:00010000:1.0:1788580977.519627:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 0000000052fbe606/0xf54e3944c2a6fd5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fd62 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580977.519635:0:5857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 0000000052fbe606/0xf54e3944c2a6fd5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fd62 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788580977.519700:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b71ff1fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014189184:0@lo:501: 00000100:00100000:1.0:1788580977.519729:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580977.519755:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 000000009954eae5 going to sleep for 11 seconds 00000100:00100000:0.0:1788580977.519805:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014189184 00000100:00100000:0.0:1788580977.519808:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014189184 00000100:00100000:0.0:1788580977.519824:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788580977.519829:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c6a6c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5857:x1875463014189184:12345-0@lo:501: 00000100:00100000:0.0:1788580977.520072:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c6a6c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5857:x1875463014189184:12345-0@lo:501: Request processed in 241us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580977.520079:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788580977.520203:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b71ff1fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014189184:0@lo:501: 00000100:00100000:1.0:1788580977.520229:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b71ff1fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014189312:0@lo:503: 00000100:00100000:1.0:1788580977.520319:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580977.520330:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 000000009954eae5 going to sleep for 11 seconds 00000100:00100000:0.0:1788580977.520493:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014189312 00000100:00100000:0.0:1788580977.520498:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014189312 00000100:00100000:0.0:1788580977.520515:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788580977.520520:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a396460 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5857:x1875463014189312:12345-0@lo:503: 00000100:00100000:0.0:1788580977.520812:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a396460 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5857:x1875463014189312:12345-0@lo:503: Request processed in 292us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580977.520819:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788580977.520906:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b71ff1fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014189312:0@lo:503: 00000100:00100000:1.0:1788580977.521447:0:5906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b71ff1fd pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5906:1875463014189440:0@lo:502: 00000100:00100000:1.0:1788580977.521487:0:5906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580977.521521:0:5906:0:(client.c:2715:ptlrpc_set_wait()) set 000000009b6067bf going to sleep for 11 seconds 00000100:00100000:0.0:1788580977.521634:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014189440 00000100:00100000:0.0:1788580977.521639:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014189440 00000100:00100000:0.0:1788580977.521660:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788580977.521665:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083f61b0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5906:x1875463014189440:12345-0@lo:502: 00000100:00100000:0.0:1788580977.521862:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083f61b0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5906:x1875463014189440:12345-0@lo:502: Request processed in 196us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580977.521870:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788580977.522094:0:5906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b71ff1fd pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5906:1875463014189440:0@lo:502: 00000020:01000004:1.0:1788580977.522152:0:5906:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788580977.522177:0:5906:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000003d88114f) 00000020:00000080:1.0:1788580977.522196:0:5906:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788580977.522301:0:5906:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e3df5fbb from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788580977.522305:0:5906:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e3df5fbb from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788580977.522308:0:5906:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e3df5fbb 4 00010000:00080000:1.0:1788580977.522342:0:5906:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f7318d9e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.113@tcp at head 00010000:00010000:1.0:1788580977.524854:0:5906:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788580977.525187:0:5906:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788580977.525221:0:5906:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788580977.525235:0:5906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf54e3944c2a6fd70 00000100:00080000:1.0:1788580977.525278:0:5906:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788580977.525284:0:5906:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f7318d9e using connection 192.168.201.113@tcp/0@lo 00000100:00100000:1.0:1788580977.525325:0:5906:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b71ff1fd x1875463014189568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788580977.525349:0:5906:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788580977.525685:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b71ff1fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3337:1875463014189568:0@lo:38: 00000100:00100000:3.0:1788580977.525758:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580977.525862:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014189568 00000100:00100000:1.0:1788580977.525869:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014189568 00000100:00100000:1.0:1788580977.525948:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788580977.525955:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024a99dfe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3337:x1875463014189568:12345-0@lo:38: 00000100:00100000:1.0:1788580977.526019:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024a99dfe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3337:x1875463014189568:12345-0@lo:38: Request processed in 62us (260us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788580977.526026:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788580977.527367:0:3337:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788580977.527386:0:3337:0:(import.c:65:import_set_state_nolock()) 00000000f7318d9e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788580977.527392:0:3337:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788580977.527400:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b71ff1fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3337:1875463014189568:0@lo:38: 00000100:00100000:2.0:1788580977.527507:0:5906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000897ee47b pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5906:1875463014189696:0@lo:502: 00000100:00100000:2.0:1788580977.527576:0:5906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580977.527607:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014189696 00000100:00100000:2.0:1788580977.527612:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014189696 00000100:00100000:2.0:1788580977.527646:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788580977.527652:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a98e7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5906:x1875463014189696:12345-0@lo:502: 00000100:00100000:2.0:1788580977.527838:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a98e7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5906:x1875463014189696:12345-0@lo:502: Request processed in 186us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580977.527845:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788580977.527891:0:5906:0:(client.c:2715:ptlrpc_set_wait()) set 000000003fffbac7 going to sleep for 11 seconds 00000100:00100000:2.0:1788580977.527901:0:5906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000897ee47b pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5906:1875463014189696:0@lo:502: 00000040:00080000:2.0:1788580977.527933:0:5906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788580977.530289:0:5857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788580977.530319:0:5857:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788580977.530337:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 0000000052fbe606/0xf54e3944c2a6fd5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fd62 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580977.530348:0:5857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: 0000000052fbe606/0xf54e3944c2a6fd5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fd62 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788580977.530794:0:5857:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788580977.530797:0:5857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788580977.530798:0:5857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788580977.530799:0:5857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788580977.530800:0:5857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788580977.530802:0:5857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788580977.530803:0:5857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788580977.530804:0:5857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788580977.530805:0:5857:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788580977.530807:0:5857:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788580977.530808:0:5857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788580977.530809:0:5857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788580977.530813:0:5857:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788580977.530815:0:5857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788580977.530822:0:5857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788580977.530823:0:5857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788580977.530824:0:5857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788580977.530825:0:5857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788580977.530826:0:5857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788580977.530827:0:5857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788580977.530827:0:5857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788580977.530828:0:5857:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788580977.530829:0:5857:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788580977.530830:0:5857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788580977.530831:0:5857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788580977.530858:0:5857:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788580977.530875:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035cdbb90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014189824:0@lo:253: 00000100:00100000:1.0:1788580977.531016:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580977.531059:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c8d18a89 going to sleep for 11 seconds 00000100:00100000:2.0:1788580977.531130:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014189824 00000100:00100000:2.0:1788580977.531138:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014189824 00000100:00100000:2.0:1788580977.531184:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788580977.531193:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051961b76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5857:x1875463014189824:12345-0@lo:253: 20000000:01000000:2.0:1788580977.531218:0:5870:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788580977.531234:0:5870:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788580977.564925:0:5870:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788580977.564974:0:5870:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788580977.568075:0:5892:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788580977.568086:0:5892:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788580977.568107:0:5892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004678f837/0xf54e3944c2a6fd77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.568125:0:5892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008a2fe7e3/0xf54e3944c2a6fd46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fd3f expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.568132:0:5892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004678f837/0xf54e3944c2a6fd77 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.568170:0:5892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008a2fe7e3/0xf54e3944c2a6fd46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6fd3f expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.568184:0:5892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008a2fe7e3/0xf54e3944c2a6fd46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd3f expref: 12 pid: 5871 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788580977.568197:0:5892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b9a04b7c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5892:1875463014189952:0@lo:104: 00000100:00100000:3.0:1788580977.568293:0:5892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580977.568338:0:5892:0:(client.c:2715:ptlrpc_set_wait()) set 000000000e46f8df going to sleep for 11 seconds 00000100:00100000:3.0:1788580977.568636:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014189952 00000100:00100000:3.0:1788580977.568645:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014189952 00000100:00100000:3.0:1788580977.568703:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788580977.568713:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003459a952 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:5892:x1875463014189952:12345-0@lo:104: 00010000:00010000:3.0:1788580977.568724:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: 00000000dd7fc8b9/0xf54e3944c2a6fd3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fd46 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.568782:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788580977.568787:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003459a952 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:5892:x1875463014189952:12345-0@lo:104: Request processed in 78us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580977.568801:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788580977.568831:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788580977.568836:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: 00000000dd7fc8b9/0xf54e3944c2a6fd3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fd46 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.568843:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dd7fc8b9 already unused, calling callback (0000000046c684ac) 10000000:00010000:3.0:1788580977.568846:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: 00000000dd7fc8b9/0xf54e3944c2a6fd3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6fd46 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.568853:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: 00000000dd7fc8b9/0xf54e3944c2a6fd3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6fd46 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788580977.568859:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: 00000000dd7fc8b9/0xf54e3944c2a6fd3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6fd46 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788580977.568864:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788580977.568890:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: 00000000dd7fc8b9/0xf54e3944c2a6fd3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fd46 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.568897:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788580977.568913:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: 00000000dd7fc8b9/0xf54e3944c2a6fd3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fd46 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.568919:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: 00000000dd7fc8b9/0xf54e3944c2a6fd3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fd46 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.568948:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788580977.568949:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788580977.568951:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788580977.568973:0:5892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b9a04b7c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5892:1875463014189952:0@lo:104: 00010000:00010000:3.0:1788580977.568995:0:5892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004678f837/0xf54e3944c2a6fd77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788580977.569171:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e58fafd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014190080:0@lo:103: 00000100:00100000:2.0:1788580977.569203:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580977.569471:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014190080 00000100:00100000:3.0:1788580977.569477:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014190080 00010000:00010000:3.0:1788580977.569495:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008a2fe7e3/0xf54e3944c2a6fd46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd3f expref: 13 pid: 5871 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788580977.569535:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788580977.569543:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000897ee47b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:3339:x1875463014190080:12345-0@lo:103: 00010000:00010000:3.0:1788580977.569552:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788580977.569556:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008a2fe7e3/0xf54e3944c2a6fd46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd3f expref: 13 pid: 5871 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.569566:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008a2fe7e3/0xf54e3944c2a6fd46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd3f expref: 13 pid: 5871 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.569578:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008a2fe7e3/0xf54e3944c2a6fd46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6fd3f expref: 13 pid: 5871 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.569591:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004678f837/0xf54e3944c2a6fd77 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.569598:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004678f837/0xf54e3944c2a6fd77 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788580977.569611:0:5861:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001526076s 00010000:00010000:3.0:1788580977.569615:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004678f837/0xf54e3944c2a6fd77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.569620:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004678f837/0xf54e3944c2a6fd77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.569633:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004678f837/0xf54e3944c2a6fd77 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.569638:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004678f837/0xf54e3944c2a6fd77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.569643:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004678f837 already unused, calling callback (000000009cb1ff49) 00010000:00010000:3.0:1788580977.569647:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004678f837/0xf54e3944c2a6fd77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.569653:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004678f837/0xf54e3944c2a6fd77 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.569667:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004678f837/0xf54e3944c2a6fd77 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.569676:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788580977.569705:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000897ee47b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:3339:x1875463014190080:12345-0@lo:103: Request processed in 164us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580977.569712:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788580977.569731:0:5892:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004678f837/0xf54e3944c2a6fd77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.569736:0:5892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004678f837/0xf54e3944c2a6fd77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580977.569741:0:5892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004678f837/0xf54e3944c2a6fd77 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788580977.569801:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e58fafd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014190080:0@lo:103: 00000100:00100000:3.0:1788580977.580364:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051961b76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:5857:x1875463014189824:12345-0@lo:253: Request processed in 49165us (49341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580977.580549:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035cdbb90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5857:1875463014189824:0@lo:253: 10000000:01000000:1.0:1788580977.580571:0:5857:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788580977.580574:0:5857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788580977.580576:0:5857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788580977.580577:0:5857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788580977.580578:0:5857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788580977.580580:0:5857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788580977.580581:0:5857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788580977.580582:0:5857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788580977.580583:0:5857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788580977.580584:0:5857:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788580977.580586:0:5857:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788580977.580587:0:5857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788580977.580588:0:5857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788580977.580601:0:5857:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788580977.582601:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00080000:10000000:1.0:1788580977.586341:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788580977.586773:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788580977.587568:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788580977.587753:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788580977.588062:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788580977.588238:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788580977.589262:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788580977.589618:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788580977.589818:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788580977.590003:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788580977.590222:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788580977.590783:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788580977.629552:0:5857:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:1.0:1788580977.650699:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788580977.660790:0:5857:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788580977.661146:0:5912:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1788580977.664104:0:5911:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788580977.664111:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788580977.665750:0:5857:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788580977.665929:0:5857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788580977.666696:0:5857:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788580977.666708:0:5857:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788580977.666865:0:5857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788580977.668137:0:5857:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788580977.668750:0:5857:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788580977.668781:0:5857:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788580977.669194:0:5857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788580977.669446:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788580977.676807:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788580977.676966:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788580977.677107:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788580977.677273:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788580977.677414:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788580977.677612:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788580977.677769:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788580977.677933:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788580977.678085:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788580977.678270:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788580977.678815:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788580977.682872:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788580977.683110:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788580977.683336:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788580977.683858:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788580977.684090:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788580977.685189:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788580977.685429:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788580977.685578:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788580977.685738:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788580977.685876:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788580977.686037:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788580977.686195:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788580977.686407:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788580977.686558:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788580977.686709:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788580977.686844:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788580977.686989:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788580977.687143:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788580977.687341:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788580977.688013:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788580977.688191:0:5857:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788580977.690310:0:5857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788580977.715192:0:5912:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1788580977.771377:0:5857:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788580977.771417:0:5857:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4bbc1c73988 00100000:10000000:1.0:1788580977.771426:0:5857:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788580977.772655:0:5857:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788580977.772672:0:5857:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.113@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788580977.772688:0:5857:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788580977.772708:0:5857:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788580977.822892:0:5912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788580977.823134:0:5912:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788580977.823139:0:5912:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788580978.672669:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788580979.696628:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788580980.724567:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788580981.744714:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788580981.872525:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788580981.872533:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91904733b800 from 3 10000000:01000000:0.0:1788580981.872539:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788580981.872589:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 000000008a2fe7e3/0xf54e3944c2a6fd7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580981.872602:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 000000008a2fe7e3/0xf54e3944c2a6fd7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580981.872612:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 000000008a2fe7e3/0xf54e3944c2a6fd7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788580981.872649:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cba8c73 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014190208:0@lo:101: 00000100:00100000:0.0:1788580981.872719:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580981.872783:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cecec00b going to sleep for 11 seconds 00000100:00100000:1.0:1788580981.872999:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014190208 00000100:00100000:1.0:1788580981.873007:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014190208 00000100:00100000:1.0:1788580981.873058:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788580981.873067:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027efa715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:5874:x1875463014190208:12345-0@lo:101: 00010000:00010000:1.0:1788580981.873081:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788580981.873093:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b84d77e7/0xf54e3944c2a6fd85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fd7e expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580981.873115:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b84d77e7/0xf54e3944c2a6fd85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fd7e expref: 12 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580981.873135:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b84d77e7/0xf54e3944c2a6fd85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fd7e expref: 12 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580981.873144:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b84d77e7, rc 0) 00000100:00100000:1.0:1788580981.873184:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027efa715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5874:x1875463014190208:12345-0@lo:101: Request processed in 118us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580981.873190:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788580981.873289:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cba8c73 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014190208:0@lo:101: 00010000:00010000:0.0:1788580981.873302:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 000000008a2fe7e3/0xf54e3944c2a6fd7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fd85 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580981.873310:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 000000008a2fe7e3/0xf54e3944c2a6fd7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fd85 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788580981.873437:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cba8c73 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014190336:0@lo:256: 00000100:00100000:0.0:1788580981.873479:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580981.873498:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cecec00b going to sleep for 11 seconds 00000100:00100000:1.0:1788580981.873550:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014190336 00000100:00100000:1.0:1788580981.873555:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014190336 00000100:00100000:1.0:1788580981.873582:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788580981.873587:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d960cc7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5874:x1875463014190336:12345-0@lo:256: 20000000:01000000:1.0:1788580981.873601:0:5870:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788580981.873616:0:5870:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788580981.873619:0:5870:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788580981.873691:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d960cc7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5874:x1875463014190336:12345-0@lo:256: Request processed in 103us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580981.873698:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788580981.873778:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cba8c73 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014190336:0@lo:256: 10000000:01000000:0.0:1788580981.873820:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788580981.873826:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: 000000008a2fe7e3/0xf54e3944c2a6fd7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fd85 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580981.873834:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: 000000008a2fe7e3/0xf54e3944c2a6fd7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fd85 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:0.0:1788580982.625810:0:6154:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788580982.769587:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788580982.898735:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788580982.898744:0:474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788580982.898747:0:474:0:(import.c:65:import_set_state_nolock()) 00000000f7318d9e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788580982.898759:0:474:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f7318d9e using connection 192.168.201.113@tcp/0@lo 00000100:00100000:3.0:1788580982.898778:0:474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b4188a3b x1875463014190592/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788580982.898999:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b9a04b7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014190464:0@lo:400: 00000100:00100000:1.0:1788580982.899064:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580982.899077:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4188a3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3337:1875463014190592:0@lo:38: 00000100:00100000:3.0:1788580982.899105:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580982.899472:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014190464 00000100:00100000:0.0:1788580982.899481:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014190464 00000100:00100000:0.0:1788580982.899529:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788580982.899537:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdf7fa21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:3340:x1875463014190464:12345-0@lo:400: 00000100:00100000:0.0:1788580982.899617:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdf7fa21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:3340:x1875463014190464:12345-0@lo:400: Request processed in 80us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580982.899625:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788580982.899666:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014190592 00000100:00100000:0.0:1788580982.899670:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014190592 00000100:00100000:0.0:1788580982.899688:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788580982.899692:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a85a545c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3337:x1875463014190592:12345-0@lo:38: 00000100:00100000:1.0:1788580982.899696:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b9a04b7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014190464:0@lo:400: 00010000:00080000:0.0:1788580982.899711:0:5878:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:0.0:1788580982.899744:0:5878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf54e3944c2a6fd8c 00000004:00100000:0.0:1788580982.899787:0:5878:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788580982.899901:0:5878:0:(import.c:65:import_set_state_nolock()) 00000000b7514b1e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788580982.899953:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a85a545c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3337:x1875463014190592:12345-0@lo:38: Request processed in 259us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580982.899960:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788580982.899993:0:3337:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b4188a3b x1875463014190592/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788580992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788580982.900006:0:3337:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788580982.900013:0:3337:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788580982.900017:0:3337:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788580982.900023:0:3337:0:(import.c:65:import_set_state_nolock()) 00000000f7318d9e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788580982.900029:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4188a3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3337:1875463014190592:0@lo:38: 00010000:00010000:1.0:1788580983.792336:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788580984.815512:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788580985.851521:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788580986.863722:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788580987.730824:0:6356:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe93a5c500 20000000:00000080:1.0:1788580987.730841:0:6356:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff919049b03c00 uarg=0000000000000000 20000000:01000000:1.0:1788580987.730870:0:6356:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788580987.730878:0:6356:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788580987.730883:0:6356:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788580987.731106:0:6356:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788580987.731119:0:6356:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788580987.737597:0:6356:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788580987.737976:0:6356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788580987.738041:0:6356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788580987.738090:0:6356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788580987.738107:0:6356:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788580987.738127:0:6356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000082f3b39e/0xf54e3944c2a6fd93 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580987.738143:0:6356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000067fed1a3/0xf54e3944c2a6fd54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fd4d expref: 11 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580987.738150:0:6356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000082f3b39e/0xf54e3944c2a6fd93 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580987.738187:0:6356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000067fed1a3/0xf54e3944c2a6fd54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6fd4d expref: 11 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580987.738215:0:6356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000067fed1a3/0xf54e3944c2a6fd54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd4d expref: 11 pid: 5870 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788580987.738268:0:6356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035cdbb90 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6356:1875463014190720:0@lo:104: 00000100:00100000:1.0:1788580987.738333:0:6356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580987.739498:0:6356:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c0263f9 going to sleep for 11 seconds 00000100:00100000:2.0:1788580987.739599:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014190720 00000100:00100000:2.0:1788580987.739609:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014190720 00000100:00100000:2.0:1788580987.739661:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788580987.739670:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d94a604d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:6356:x1875463014190720:12345-0@lo:104: 00010000:00010000:2.0:1788580987.739684:0:5860:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: 000000004838b099/0xf54e3944c2a6fd4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fd54 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.739767:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788580987.739772:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d94a604d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:6356:x1875463014190720:12345-0@lo:104: Request processed in 104us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580987.739779:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788580987.739812:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788580987.739817:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: 000000004838b099/0xf54e3944c2a6fd4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fd54 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.739824:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004838b099 already unused, calling callback (0000000046c684ac) 10000000:00010000:2.0:1788580987.739827:0:5865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: 000000004838b099/0xf54e3944c2a6fd4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6fd54 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.739833:0:5865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: 000000004838b099/0xf54e3944c2a6fd4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6fd54 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788580987.739839:0:5865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: 000000004838b099/0xf54e3944c2a6fd4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6fd54 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788580987.739843:0:5865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788580987.739876:0:5865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: 000000004838b099/0xf54e3944c2a6fd4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fd54 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.739897:0:5865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788580987.739914:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: 000000004838b099/0xf54e3944c2a6fd4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fd54 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.739919:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: 000000004838b099/0xf54e3944c2a6fd4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fd54 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.739937:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788580987.739938:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788580987.739940:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788580987.739953:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005025c461 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014190848:0@lo:103: 00000100:00100000:2.0:1788580987.739985:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580987.740024:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014190848 00000100:00100000:2.0:1788580987.740028:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014190848 00010000:00010000:2.0:1788580987.740044:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000067fed1a3/0xf54e3944c2a6fd54 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd4d expref: 12 pid: 5870 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788580987.740063:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788580987.740070:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b884a5f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:3341:x1875463014190848:12345-0@lo:103: 00010000:00010000:2.0:1788580987.740079:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788580987.740084:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000067fed1a3/0xf54e3944c2a6fd54 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd4d expref: 12 pid: 5870 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.740092:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000067fed1a3/0xf54e3944c2a6fd54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd4d expref: 12 pid: 5870 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.740108:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000082f3b39e/0xf54e3944c2a6fd93 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.740124:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000082f3b39e/0xf54e3944c2a6fd93 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.740136:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000082f3b39e/0xf54e3944c2a6fd93 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.740141:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000082f3b39e/0xf54e3944c2a6fd93 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.740147:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000082f3b39e/0xf54e3944c2a6fd93 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.740152:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000082f3b39e/0xf54e3944c2a6fd93 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.740157:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000082f3b39e already unused, calling callback (000000009cb1ff49) 00010000:00010000:2.0:1788580987.740161:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000082f3b39e/0xf54e3944c2a6fd93 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.740166:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000082f3b39e/0xf54e3944c2a6fd93 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.740174:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000082f3b39e/0xf54e3944c2a6fd93 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.740183:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788580987.740222:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b884a5f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:3341:x1875463014190848:12345-0@lo:103: Request processed in 153us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580987.740229:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788580987.740287:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005025c461 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014190848:0@lo:103: 00010000:00010000:1.0:1788580987.740593:0:6356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000067fed1a3/0xf54e3944c2a6fd54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6fd4d expref: 11 pid: 5870 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788580987.740605:0:6356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035cdbb90 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6356:1875463014190720:0@lo:104: 00010000:00010000:1.0:1788580987.740618:0:6356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000082f3b39e/0xf54e3944c2a6fd93 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580987.740626:0:6356:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000082f3b39e/0xf54e3944c2a6fd93 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580987.740630:0:6356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000082f3b39e/0xf54e3944c2a6fd93 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580987.740635:0:6356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000082f3b39e/0xf54e3944c2a6fd93 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580987.895434:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788580988.018738:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9b70648 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014190976:0@lo:400: 00000100:00100000:2.0:1788580988.018978:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580988.019032:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788580988.019039:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000836e59d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3338:1875463014191104:0@lo:400: 00000100:00100000:2.0:1788580988.019067:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580988.019104:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014190976 00000100:00100000:2.0:1788580988.019112:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014190976 00000100:00100000:2.0:1788580988.019157:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788580988.019164:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054db7c46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:3338:x1875463014190976:12345-0@lo:400: 00000100:00100000:2.0:1788580988.019997:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054db7c46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:3338:x1875463014190976:12345-0@lo:400: Request processed in 831us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580988.020006:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788580988.020043:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014191104 00000100:00100000:2.0:1788580988.020048:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014191104 00000100:00100000:2.0:1788580988.020080:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788580988.020087:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005025c461 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3338:x1875463014191104:12345-0@lo:400: 00000100:00100000:2.0:1788580988.020121:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005025c461 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3338:x1875463014191104:12345-0@lo:400: Request processed in 35us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580988.020127:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788580988.020166:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000836e59d4 x1875463014191104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788580988.020181:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000836e59d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3338:1875463014191104:0@lo:400: 00000100:00100000:2.0:1788580988.020189:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9b70648 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014190976:0@lo:400: 00010000:00010000:2.0:1788580988.918340:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788580989.936058:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788580990.767478:0:5874:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788580990.767485:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91904733b800 from 1 10000000:01000000:0.0:1788580990.767491:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788580990.767537:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: 00000000bae5f752/0xf54e3944c2a6fd9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580990.767551:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: 00000000bae5f752/0xf54e3944c2a6fd9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580990.767561:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: 00000000bae5f752/0xf54e3944c2a6fd9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788580990.767587:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cba8c73 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014191232:0@lo:101: 00000100:00100000:0.0:1788580990.767653:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580990.767740:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set 000000008e3ff324 going to sleep for 11 seconds 00000100:00100000:1.0:1788580990.768186:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014191232 00000100:00100000:1.0:1788580990.768196:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014191232 00000100:00100000:1.0:1788580990.768275:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788580990.768285:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b846e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:5874:x1875463014191232:12345-0@lo:101: 00010000:00010000:1.0:1788580990.768311:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788580990.768325:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b95266d5/0xf54e3944c2a6fda1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fd9a expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580990.768350:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b95266d5/0xf54e3944c2a6fda1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fd9a expref: 12 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580990.768368:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b95266d5/0xf54e3944c2a6fda1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fd9a expref: 12 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580990.768378:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b95266d5, rc 0) 00000100:00100000:1.0:1788580990.768429:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b846e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5874:x1875463014191232:12345-0@lo:101: Request processed in 147us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580990.768436:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788580990.768491:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cba8c73 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014191232:0@lo:101: 00010000:00010000:1.0:1788580990.768505:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: 00000000bae5f752/0xf54e3944c2a6fd9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fda1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580990.768512:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: 00000000bae5f752/0xf54e3944c2a6fd9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fda1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788580990.768567:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035cdbb90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014191360:0@lo:501: 00000100:00100000:1.0:1788580990.768596:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580990.768621:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set 000000008300f7c4 going to sleep for 11 seconds 00000100:00100000:0.0:1788580990.768692:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014191360 00000100:00100000:0.0:1788580990.768697:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014191360 00000100:00100000:0.0:1788580990.768725:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788580990.768731:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6dc6b84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5874:x1875463014191360:12345-0@lo:501: 00000100:00100000:0.0:1788580990.769023:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6dc6b84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5874:x1875463014191360:12345-0@lo:501: Request processed in 292us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580990.769030:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788580990.769524:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035cdbb90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014191360:0@lo:501: 00000100:00100000:1.0:1788580990.769558:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035cdbb90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014191488:0@lo:503: 00000100:00100000:1.0:1788580990.769605:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580990.769637:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set 000000008300f7c4 going to sleep for 11 seconds 00000100:00100000:0.0:1788580990.774901:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014191488 00000100:00100000:0.0:1788580990.774917:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014191488 00000100:00100000:0.0:1788580990.774982:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788580990.774991:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be6dc7aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5874:x1875463014191488:12345-0@lo:503: 00000100:00100000:0.0:1788580990.775390:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be6dc7aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5874:x1875463014191488:12345-0@lo:503: Request processed in 399us (5784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580990.775398:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788580990.775718:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035cdbb90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014191488:0@lo:503: 00000100:00100000:0.0:1788580990.777085:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000200320d9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6476:1875463014191616:0@lo:502: 00000100:00100000:0.0:1788580990.777162:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580990.777209:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014191616 00000100:00100000:0.0:1788580990.777216:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014191616 00000100:00100000:0.0:1788580990.777276:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788580990.777284:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080788615 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:6476:x1875463014191616:12345-0@lo:502: 00000100:00100000:0.0:1788580990.777471:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080788615 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:6476:x1875463014191616:12345-0@lo:502: Request processed in 187us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580990.777478:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788580990.777536:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010f23af4 going to sleep for 11 seconds 00000100:00100000:0.0:1788580990.777552:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000200320d9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6476:1875463014191616:0@lo:502: 00000020:01000000:0.0:1788580990.777578:0:6476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788580990.777594:0:6476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788580990.777596:0:6476:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788580990.777604:0:6476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91904733b800 00000020:00000080:0.0:1788580990.777606:0:6476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788580990.777643:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b76a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6476:1875463014191744:0@lo:502: 00000100:00100000:0.0:1788580990.777675:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580990.777707:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set ffff919049f709c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788580990.777853:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014191744 00000100:00100000:3.0:1788580990.777858:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014191744 00000100:00100000:3.0:1788580990.777889:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788580990.777895:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:6476:x1875463014191744:12345-0@lo:502: 00000100:00100000:3.0:1788580990.778035:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:6476:x1875463014191744:12345-0@lo:502: Request processed in 138us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580990.778042:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788580990.778080:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b76a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6476:1875463014191744:0@lo:502: 00000020:01000000:3.0:1788580990.778097:0:6476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788580990.778101:0:6476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788580990.778103:0:6476:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788580990.778106:0:6476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788580990.778157:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788580990.778172:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788580990.778181:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040031400/0xf54e3944c2a6fd9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fda1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580990.778198:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919040031400/0xf54e3944c2a6fd9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fda1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580990.972679:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788580991.983644:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788580993.008088:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788580993.138201:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014192000:0@lo:400: 00000100:00100000:2.0:1788580993.138418:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580993.138503:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788580993.138510:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014191872:0@lo:400: 00000100:00100000:2.0:1788580993.138549:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580993.138857:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014192000 00000100:00100000:3.0:1788580993.138869:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014192000 00000100:00100000:3.0:1788580993.138927:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788580993.138940:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014192000:12345-0@lo:400: 00000100:00100000:3.0:1788580993.139017:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014192000:12345-0@lo:400: Request processed in 80us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580993.139026:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788580993.139062:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014191872 00000100:00100000:3.0:1788580993.139065:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014191872 00000100:00100000:3.0:1788580993.139096:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788580993.139104:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:3341:x1875463014191872:12345-0@lo:400: 00000100:00100000:3.0:1788580993.139136:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:3341:x1875463014191872:12345-0@lo:400: Request processed in 33us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580993.139143:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788580993.142631:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014191872:0@lo:400: 00010000:00080000:3.0:1788580993.145361:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff919048580e00 x1875463014192000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788580993.145388:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014192000:0@lo:400: 00010000:00010000:2.0:1788580994.042071:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788580995.055676:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788580995.741845:0:6720:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788580995.741850:0:6720:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788580995.741992:0:6720:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91906c6c6000 00000020:01000004:3.0:1788580995.742007:0:6720:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788580995.742019:0:6720:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788580995.742039:0:6720:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff919047dc99b8) 00000020:00000080:3.0:1788580995.742057:0:6720:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788580995.760696:0:6720:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788580995.760957:0:6720:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788580995.787799:0:6720:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788580995.793187:0:6720:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788580995.793232:0:6720:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788580995.793396:0:6720:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788580995.793426:0:6720:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788580995.793927:0:6720:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788580995.793939:0:6720:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788580995.793950:0:6720:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf54e3944c2a6fdaf 00000020:01000004:3.0:1788580995.793958:0:6720:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788580995.793979:0:6720:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788580995.793982:0:6720:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788580995.793988:0:6720:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788580995.793992:0:6720:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788580995.794015:0:6720:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff919046a6cd28) 00000020:00000080:3.0:1788580995.794027:0:6720:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788580995.797265:0:6720:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788580995.797469:0:6720:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788580995.797475:0:6720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788580995.800941:0:6720:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788580995.800959:0:6720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788580995.804536:0:6720:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788580995.804547:0:6720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788580995.805764:0:6720:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788580995.805922:0:6720:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788580995.805926:0:6720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788580995.806322:0:6720:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788580995.806329:0:6720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788580995.820390:0:6720:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788580995.820630:0:6720:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788580995.820637:0:6720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788580995.824453:0:6720:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788580995.824695:0:6720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788580995.825907:0:6720:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788580995.825915:0:6720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788580995.828235:0:6720:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788580995.828619:0:6720:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788580995.828624:0:6720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788580995.829113:0:6720:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788580995.829129:0:6720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788580995.913674:0:6720:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788580995.913896:0:6720:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788580995.913903:0:6720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788580995.916277:0:6720:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788580995.916294:0:6720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788580995.917151:0:6720:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788580995.917177:0:6720:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788580995.917184:0:6720:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788580995.951876:0:6720:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788580995.951916:0:6720:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.113@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788580995.951922:0:6720:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788580995.951924:0:6720:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788580995.951925:0:6720:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788580995.951926:0:6720:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788580995.951928:0:6720:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788580995.951929:0:6720:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788580995.951931:0:6720:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788580995.951932:0:6720:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788580995.951934:0:6720:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788580995.951936:0:6720:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788580995.951937:0:6720:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788580995.951941:0:6720:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788580995.951944:0:6720:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788580995.951945:0:6720:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788580995.951946:0:6720:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788580995.951947:0:6720:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788580995.951948:0:6720:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788580995.951949:0:6720:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788580995.951951:0:6720:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788580995.951952:0:6720:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788580995.951953:0:6720:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788580995.951954:0:6720:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788580995.951955:0:6720:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788580995.951980:0:6720:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788580995.952000:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014192128:0@lo:253: 00000100:00100000:1.0:1788580995.952204:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580995.952314:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff91904510a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788580995.952801:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014192128 00000100:00100000:2.0:1788580995.952811:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014192128 00000100:00100000:2.0:1788580995.952889:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788580995.952901:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:6720:x1875463014192128:12345-0@lo:253: 20000000:01000000:2.0:1788580995.952945:0:5870:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788580995.952949:0:5870:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788580995.952954:0:5870:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788580995.952958:0:5870:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788580995.953929:0:5870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788580995.954132:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788580995.954145:0:5870:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788580995.954182:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788580995.954190:0:5870:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788580995.954271:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788580995.954324:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788580995.954695:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788580995.954713:0:5870:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.113@tcp 20000000:01000000:2.0:1788580995.954715:0:5870:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.113@tcp (null) (null) (null) 00000040:00080000:2.0:1788580995.954750:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788580995.954758:0:5870:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788580995.954800:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788580995.954808:0:5870:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.113@tcp (null) (null) 00000040:00080000:2.0:1788580995.954838:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788580995.954846:0:5870:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788580995.954873:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788580995.954920:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788580995.955646:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788580995.955663:0:5870:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.113@tcp 20000000:01000000:2.0:1788580995.955665:0:5870:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.113@tcp (null) (null) (null) 00000040:00080000:2.0:1788580995.955698:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788580995.955705:0:5870:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788580995.955735:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788580995.955743:0:5870:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.113@tcp (null) (null) 00000040:00080000:2.0:1788580995.955783:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788580995.955791:0:5870:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788580995.955818:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788580995.955847:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788580995.955861:0:5870:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788580995.955865:0:5870:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788580995.955871:0:5870:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788580995.955872:0:5870:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788580995.955874:0:5870:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788580995.955885:0:5870:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788580995.955888:0:5870:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788580995.955917:0:5870:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788580995.955926:0:5870:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788580995.962838:0:6735:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788580995.962930:0:6735:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788580995.962979:0:6735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788580995.963997:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1788580995.964038:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1788580995.964068:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1788580995.964081:0:5870:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788580995.964085:0:5870:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788580995.965406:0:6736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788580995.965701:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788580995.965745:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788580995.965840:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788580995.965854:0:5870:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788580995.965856:0:5870:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788580995.966819:0:6737:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1788580995.966889:0:6737:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1788580995.966929:0:6737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788580995.971026:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788580995.971069:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788580995.971417:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:3.0:1788580995.971440:0:5870:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788580995.971459:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdbd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580995.971476:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190414b2000/0xf54e3944c2a6fcd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fccf expref: 12 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580995.971483:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919040030c00/0xf54e3944c2a6fcf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fceb expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580995.971488:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919040031a00/0xf54e3944c2a6fd62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fd5b expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580995.971495:0:5870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdbd lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580995.971532:0:5870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919040031a00/0xf54e3944c2a6fd62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6fd5b expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580995.971548:0:5870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919040031a00/0xf54e3944c2a6fd62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd5b expref: 12 pid: 5871 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788580995.971563:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5870:1875463014192256:0@lo:104: 00000100:00100000:3.0:1788580995.974222:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788580995.975360:0:5870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919040030c00/0xf54e3944c2a6fcf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6fceb expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580995.975378:0:5870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919040030c00/0xf54e3944c2a6fcf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6fceb expref: 12 pid: 5871 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788580995.975393:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5870:1875463014192384:0@lo:104: 00000100:00100000:3.0:1788580995.975444:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788580995.979524:0:5870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190414b2000/0xf54e3944c2a6fcd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6fccf expref: 12 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580995.979543:0:5870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9190414b2000/0xf54e3944c2a6fcd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6fccf expref: 12 pid: 5869 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788580995.979558:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5870:1875463014192512:0@lo:104: 00000100:00100000:3.0:1788580995.979613:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580995.981592:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014192256 00000100:00100000:2.0:1788580995.981606:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014192256 00000100:00100000:2.0:1788580995.981674:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014192384 00000100:00100000:2.0:1788580995.981678:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014192384 00000100:00100000:2.0:1788580995.981696:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788580995.981705:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+4:5870:x1875463014192256:12345-0@lo:104: 00010000:00010000:2.0:1788580995.981727:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff919044ca9000/0xf54e3944c2a6fd5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fd62 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580995.981826:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788580995.981832:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+4:5870:x1875463014192256:12345-0@lo:104: Request processed in 128us (7628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580995.981839:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788580995.981857:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788580995.981864:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:5870:x1875463014192384:12345-0@lo:104: 00010000:00010000:2.0:1788580995.981872:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fcf2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.981878:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788580995.981885:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919044ca9000/0xf54e3944c2a6fd5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fd62 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.981893:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9000 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:0.0:1788580995.981897:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919044ca9000/0xf54e3944c2a6fd5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6fd62 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.981905:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919044ca9000/0xf54e3944c2a6fd5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6fd62 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580995.981907:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788580995.981912:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:5870:x1875463014192384:12345-0@lo:104: Request processed in 49us (6468us total) trans 0 rc 0/0 10000000:00010000:0.0:1788580995.981913:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919044ca9000/0xf54e3944c2a6fd5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6fd62 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788580995.981919:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788580995.981937:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788580995.981952:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788580995.981956:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919044ca9000/0xf54e3944c2a6fd5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fd62 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.981962:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788580995.981982:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919044ca9000/0xf54e3944c2a6fd5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fd62 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788580995.981991:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1788580995.981996:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919044ca9000/0xf54e3944c2a6fd5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fd62 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788580995.982006:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014192640:0@lo:103: 00010000:00010000:0.0:1788580995.982011:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788580995.982012:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788580995.982014:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788580995.982047:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580995.982238:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014192640 00000100:00100000:0.0:1788580995.982258:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014192640 00010000:00010000:0.0:1788580995.982280:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919040031a00/0xf54e3944c2a6fd62 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd5b expref: 13 pid: 5871 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788580995.982303:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788580995.982310:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048580380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:3339:x1875463014192640:12345-0@lo:103: 00010000:00010000:0.0:1788580995.982320:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788580995.982326:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919040031a00/0xf54e3944c2a6fd62 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd5b expref: 13 pid: 5871 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.982336:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919040031a00/0xf54e3944c2a6fd62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd5b expref: 13 pid: 5871 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.982353:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788580995.982399:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048580380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:3339:x1875463014192640:12345-0@lo:103: Request processed in 89us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580995.982404:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788580995.982437:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014192640:0@lo:103: 00000100:00100000:0.0:1788580995.983680:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014192512 00000100:00100000:0.0:1788580995.983689:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014192512 00000100:00100000:3.0:1788580995.983708:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190467f2300 going to sleep for 11 seconds 00000100:00100000:0.0:1788580995.983720:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788580995.983729:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919040031a00/0xf54e3944c2a6fd62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6fd5b expref: 12 pid: 5871 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788580995.983733:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:5870:x1875463014192512:12345-0@lo:104: 00010000:00010000:0.0:1788580995.983745:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff919040031e00/0xf54e3944c2a6fccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fcd6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788580995.983747:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5870:1875463014192256:0@lo:104: 00000100:00100000:3.0:1788580995.983758:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5870:1875463014192384:0@lo:104: 00010000:00010000:0.0:1788580995.983810:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788580995.983815:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:5870:x1875463014192512:12345-0@lo:104: Request processed in 84us (4202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580995.983822:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788580995.983840:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788580995.983846:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919040031e00/0xf54e3944c2a6fccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fcd6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.983853:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040031e00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:0.0:1788580995.983857:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919040031e00/0xf54e3944c2a6fccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6fcd6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.983864:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919040031e00/0xf54e3944c2a6fccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6fcd6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788580995.983871:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919040031e00/0xf54e3944c2a6fccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6fcd6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788580995.983877:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788580995.983921:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919040031e00/0xf54e3944c2a6fccf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fcd6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.983944:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788580995.983948:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5870:1875463014192512:0@lo:104: 00010000:00010000:0.0:1788580995.983957:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919040031e00/0xf54e3944c2a6fccf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fcd6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580995.983971:0:5870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdbd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.983972:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919040031e00/0xf54e3944c2a6fccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fcd6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.983982:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788580995.983984:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788580995.983986:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788580995.983993:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788580995.984004:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014192768:0@lo:103: 00010000:00010000:3.0:1788580995.984011:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788580995.984013:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788580995.984015:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788580995.984040:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788580995.984418:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fcf2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580995.984426:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cee00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:2.0:1788580995.984429:0:5865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6fcf2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580995.984436:0:5865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6fcf2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788580995.984443:0:5865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6fcf2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788580995.984448:0:5865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788580995.984475:0:5865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fceb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fcf2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580995.984481:0:5865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788580995.984496:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fceb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fcf2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580995.984502:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fceb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fcf2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580995.984518:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788580995.984526:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788580995.984528:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788580995.984648:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014192896:0@lo:103: 00000100:00100000:2.0:1788580995.984680:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580995.984755:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014192768 00000100:00100000:0.0:1788580995.984760:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014192768 00010000:00010000:0.0:1788580995.984779:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190414b2000/0xf54e3944c2a6fcd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fccf expref: 12 pid: 5869 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788580995.984805:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014192896 00000100:00100000:0.0:1788580995.984808:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014192896 00010000:00010000:0.0:1788580995.984819:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919040030c00/0xf54e3944c2a6fcf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fceb expref: 13 pid: 5871 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788580995.984832:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788580995.984838:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:3338:x1875463014192768:12345-0@lo:103: 00010000:00010000:0.0:1788580995.984860:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788580995.984865:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190414b2000/0xf54e3944c2a6fcd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fccf expref: 13 pid: 5869 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.984875:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190414b2000/0xf54e3944c2a6fcd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6fccf expref: 13 pid: 5869 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.984887:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190414b2000/0xf54e3944c2a6fcd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6fccf expref: 13 pid: 5869 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788580995.984891:0:5863:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788580995.984899:0:5863:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788580995.984904:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788580995.984937:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:3338:x1875463014192768:12345-0@lo:103: Request processed in 98us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580995.984944:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788580995.984957:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788580995.984962:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048581880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:3340:x1875463014192896:12345-0@lo:103: 00010000:00010000:0.0:1788580995.984970:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788580995.984973:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919040030c00/0xf54e3944c2a6fcf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fceb expref: 11 pid: 5871 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.984981:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919040030c00/0xf54e3944c2a6fcf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6fceb expref: 11 pid: 5871 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.984991:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919040030c00/0xf54e3944c2a6fcf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6fceb expref: 11 pid: 5871 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.985003:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdbd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.985011:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdbd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.985023:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdbd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.985030:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdbd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.985036:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdbd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.985049:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdbd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.985054:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b2800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788580995.985058:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdbd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.985064:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdbd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.985080:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdbd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580995.985090:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788580995.985132:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048581880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+10:3340:x1875463014192896:12345-0@lo:103: Request processed in 169us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580995.985138:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788580995.985171:0:5870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788580995.985171:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014192896:0@lo:103: 00010000:00010000:3.0:1788580995.985179:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580995.985185:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdbd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788580995.985194:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014192768:0@lo:103: 20000000:01000000:3.0:1788580995.985196:0:5870:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788580996.030532:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+9:6720:x1875463014192128:12345-0@lo:253: Request processed in 77624us (78447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580996.030547:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788580996.030625:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014192128:0@lo:253: 10000000:01000000:1.0:1788580996.030642:0:6720:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788580996.030645:0:6720:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788580996.030647:0:6720:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788580996.030648:0:6720:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788580996.030649:0:6720:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788580996.030651:0:6720:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788580996.030652:0:6720:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788580996.030654:0:6720:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788580996.030655:0:6720:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788580996.030657:0:6720:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788580996.030659:0:6720:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788580996.030678:0:6720:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91906c6c6000 from lustre-OST0000 10000000:01000000:1.0:1788580996.030695:0:6720:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788580996.030697:0:6720:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788580996.030703:0:6720:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff919047dccd28 local copy 10000000:01000000:1.0:1788580996.030706:0:6720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788580996.030735:0:6720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca8000/0xf54e3944c2a6fdc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.030744:0:6720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.113@tcp lock: ffff919044ca8000/0xf54e3944c2a6fdc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.030751:0:6720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919044ca8000/0xf54e3944c2a6fdc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788580996.030763:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014193024:0@lo:101: 00000100:00100000:1.0:1788580996.030790:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580996.030844:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014193024 00000100:00100000:3.0:1788580996.030851:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014193024 00000100:00100000:1.0:1788580996.030858:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff91904510a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788580996.030897:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788580996.030906:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+9:6720:x1875463014193024:12345-0@lo:101: 00010000:00010000:3.0:1788580996.030918:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788580996.030931:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fdc4 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580996.030953:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fdc4 expref: 10 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580996.030963:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fdc4 expref: 10 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580996.030973:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190414b2800, rc 0) 00000100:00100000:3.0:1788580996.031002:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+10:6720:x1875463014193024:12345-0@lo:101: Request processed in 97us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580996.031017:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014193024:0@lo:101: 00000100:00100000:3.0:1788580996.031026:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788580996.031034:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919044ca8000/0xf54e3944c2a6fdc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf54e3944c2a6fdcb expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.031043:0:6720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919044ca8000/0xf54e3944c2a6fdc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf54e3944c2a6fdcb expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788580996.031304:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014193152:0@lo:501: 00000100:00100000:1.0:1788580996.031323:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580996.031342:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff91904510a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788580996.031360:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014193152 00000100:00100000:3.0:1788580996.031364:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014193152 00000100:00100000:3.0:1788580996.031390:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788580996.031396:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+10:6720:x1875463014193152:12345-0@lo:501: 00000100:00100000:3.0:1788580996.031586:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+10:6720:x1875463014193152:12345-0@lo:501: Request processed in 189us (260us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788580996.031594:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788580996.031631:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014193152:0@lo:501: 10000000:01000000:1.0:1788580996.031648:0:6720:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788580996.031672:0:6720:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788580996.031678:0:6720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca8000/0xf54e3944c2a6fdc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf54e3944c2a6fdcb expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.031686:0:6720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca8000/0xf54e3944c2a6fdc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf54e3944c2a6fdcb expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.031691:0:6720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff919044ca8000/0xf54e3944c2a6fdc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf54e3944c2a6fdcb expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.031737:0:6720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788580996.031753:0:6720:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91906c6c6000 10000000:01000000:1.0:1788580996.031757:0:6720:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788580996.031760:0:6720:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff919047dccd28 10000000:01000000:1.0:1788580996.031762:0:6720:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788580996.031764:0:6720:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff919047dccd28 from 1 10000000:01000000:1.0:1788580996.031766:0:6720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788580996.031777:0:6720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca8200/0xf54e3944c2a6fdd2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.031787:0:6720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919044ca8200/0xf54e3944c2a6fdd2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.031793:0:6720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919044ca8200/0xf54e3944c2a6fdd2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788580996.031800:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014193280:0@lo:101: 00000100:00100000:1.0:1788580996.031817:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580996.031832:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff91904510a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788580996.031855:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014193280 00000100:00100000:3.0:1788580996.031859:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014193280 00010000:00010000:0.0:1788580996.031864:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788580996.031871:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919044ca8000/0xf54e3944c2a6fdc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf54e3944c2a6fdcb expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580996.031879:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8000 already unused, calling callback (ffffffffc1cf0c20) 00000100:00100000:3.0:1788580996.031883:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 10000000:00010000:0.0:1788580996.031883:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919044ca8000/0xf54e3944c2a6fdc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf54e3944c2a6fdcb expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788580996.031889:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+10:6720:x1875463014193280:12345-0@lo:101: 00010000:00010000:0.0:1788580996.031891:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919044ca8000/0xf54e3944c2a6fdc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf54e3944c2a6fdcb expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580996.031896:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788580996.031904:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190414b3000/0xf54e3944c2a6fdd9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fdd2 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788580996.031906:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919044ca8000/0xf54e3944c2a6fdc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf54e3944c2a6fdcb expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788580996.031912:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788580996.031917:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190414b3000/0xf54e3944c2a6fdd9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fdd2 expref: 11 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580996.031925:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190414b3000/0xf54e3944c2a6fdd9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fdd2 expref: 11 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580996.031931:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919044ca8000/0xf54e3944c2a6fdc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf54e3944c2a6fdcb expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580996.031932:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190414b3000, rc 0) 00010000:00010000:0.0:1788580996.031937:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788580996.031957:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:6720:x1875463014193280:12345-0@lo:101: Request processed in 68us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580996.031963:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1788580996.031965:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919044ca8000/0xf54e3944c2a6fdc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf54e3944c2a6fdcb expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580996.031971:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919044ca8000/0xf54e3944c2a6fdc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf54e3944c2a6fdcb expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580996.031986:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788580996.031989:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788580996.031991:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788580996.031998:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788580996.032009:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014193408:0@lo:103: 00000100:00100000:0.0:1788580996.032038:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580996.032062:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014193408 00000100:00100000:3.0:1788580996.032066:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014193408 00000100:00100000:1.0:1788580996.032226:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014193280:0@lo:101: 00010000:00010000:1.0:1788580996.032236:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919044ca8200/0xf54e3944c2a6fdd2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fdd9 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.032263:0:6720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919044ca8200/0xf54e3944c2a6fdd2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fdd9 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788580996.032278:0:6720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'nodemap' succeeded (0). 00000100:00100000:3.0:1788580996.032283:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788580996.032290:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:3340:x1875463014193408:12345-0@lo:103: 00010000:00010000:1.0:1788580996.032293:0:6720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca8200/0xf54e3944c2a6fdd2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fdd9 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580996.032298:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788580996.032300:0:6720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919044ca8200/0xf54e3944c2a6fdd2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fdd9 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788580996.032306:0:6720:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 00010000:00010000:3.0:1788580996.032308:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190414b2800/0xf54e3944c2a6fdcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf54e3944c2a6fdc4 expref: 11 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788580996.032310:0:6720:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788580996.032314:0:6720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788580996.032316:0:6720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788580996.032318:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788580996.032326:0:6720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6fde0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.032339:0:6720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6fde0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788580996.032342:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+10:3340:x1875463014193408:12345-0@lo:103: Request processed in 54us (305us total) trans 0 rc 0/0 00010000:00010000:1.0:1788580996.032347:0:6720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6fde0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788580996.032348:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788580996.032358:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014193536:0@lo:101: 00000100:00100000:0.0:1788580996.032473:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014193408:0@lo:103: 00000100:00100000:1.0:1788580996.032523:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580996.032605:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014193536 00000100:00100000:3.0:1788580996.032610:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014193536 00000100:00100000:1.0:1788580996.032617:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff91904510a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788580996.032646:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788580996.032654:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+10:6720:x1875463014193536:12345-0@lo:101: 00010000:00010000:3.0:1788580996.032661:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788580996.032669:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190414b3a00/0xf54e3944c2a6fde7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fde0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580996.032680:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190414b3a00/0xf54e3944c2a6fde7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fde0 expref: 11 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580996.032686:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190414b3a00/0xf54e3944c2a6fde7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fde0 expref: 11 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580996.032690:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190414b3a00, rc 0) 00000100:00100000:3.0:1788580996.032715:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:6720:x1875463014193536:12345-0@lo:101: Request processed in 63us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580996.032721:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788580996.032743:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014193536:0@lo:101: 00010000:00010000:1.0:1788580996.032752:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6fde0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fde7 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.032759:0:6720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6fde0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fde7 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788580996.032837:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014193664:0@lo:501: 00000100:00100000:1.0:1788580996.032854:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580996.032869:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff91904510a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788580996.032884:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014193664 00000100:00100000:3.0:1788580996.032894:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014193664 00000100:00100000:3.0:1788580996.032922:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788580996.032928:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:6720:x1875463014193664:12345-0@lo:501: 00000100:00100000:3.0:1788580996.033230:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:6720:x1875463014193664:12345-0@lo:501: Request processed in 301us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580996.033231:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014193664:0@lo:501: 00000100:00100000:3.0:1788580996.033237:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788580996.033279:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014193792:0@lo:503: 00000100:00100000:1.0:1788580996.033315:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580996.033354:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014193792 00000100:00100000:3.0:1788580996.033358:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014193792 00000100:00100000:2.0:1788580996.033402:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff91904510a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788580996.033437:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788580996.033444:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:6720:x1875463014193792:12345-0@lo:503: 00000100:00100000:3.0:1788580996.033616:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:6720:x1875463014193792:12345-0@lo:503: Request processed in 173us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580996.033628:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788580996.033706:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014193792:0@lo:503: 00000040:00080000:2.0:1788580996.033917:0:6720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788580996.033960:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014193920:0@lo:502: 00000100:00100000:2.0:1788580996.033985:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580996.034028:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190467f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788580996.034056:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014193920 00000100:00100000:3.0:1788580996.034059:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014193920 00000100:00100000:0.0:1788580996.034312:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788580996.034322:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:6720:x1875463014193920:12345-0@lo:502: 00000100:00100000:0.0:1788580996.034694:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:6720:x1875463014193920:12345-0@lo:502: Request processed in 372us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580996.034701:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788580996.034720:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014193920:0@lo:502: 00000040:00080000:2.0:1788580996.034901:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788580996.034934:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788580996.034950:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788580996.034984:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788580996.035005:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788580996.035020:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788580996.035039:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014194048:0@lo:502: 00000100:00100000:2.0:1788580996.035065:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580996.035333:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190467f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788580996.035396:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014194048 00000100:00100000:3.0:1788580996.035402:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014194048 00000100:00100000:3.0:1788580996.035440:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788580996.035448:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:6720:x1875463014194048:12345-0@lo:502: 00000100:00100000:3.0:1788580996.035633:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:6720:x1875463014194048:12345-0@lo:502: Request processed in 186us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580996.035639:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788580996.035899:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014194048:0@lo:502: 00000040:00080000:2.0:1788580996.035974:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788580996.035982:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788580996.036805:0:6741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788580996.036815:0:6741:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788580996.036822:0:6741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788580996.036825:0:6741:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788580996.036837:0:6741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788580996.036852:0:6741:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff919075ed4d28) 00000020:00000080:1.0:1788580996.036875:0:6741:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788580996.036881:0:6741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788580996.036955:0:6741:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91906c6c6000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788580996.036962:0:6741:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788580996.036970:0:6741:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf54e3944c2a6fdf5 00010000:00010000:2.0:1788580996.042575:0:6741:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788580996.043476:0:6741:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788580996.046489:0:6741:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788580996.046935:0:6741:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788580996.057860:0:6741:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788580996.058696:0:6741:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788580996.061155:0:6741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788580996.061169:0:6741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788580996.061176:0:6741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788580996.061179:0:6741:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788580996.061183:0:6741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788580996.061187:0:6741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788580996.061188:0:6741:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788580996.061191:0:6741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788580996.061192:0:6741:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788580996.061383:0:6741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788580996.061387:0:6741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788580996.061389:0:6741:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788580996.061392:0:6741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788580996.071371:0:6720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788580996.071419:0:6720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788580996.072414:0:6720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6fde0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fde7 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580996.072439:0:6720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6fde0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fde7 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788580996.072448:0:6720:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91906c6c6000 from 1 10000000:01000000:2.0:1788580996.072452:0:6720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788580996.072492:0:6720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fdfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580996.072501:0:6720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fdfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580996.072512:0:6720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fdfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788580996.072541:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014194176:0@lo:101: 00000100:00100000:2.0:1788580996.072612:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580996.072672:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff919042bdc540 going to sleep for 11 seconds 00000100:00100000:1.0:1788580996.073384:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014194176 00000100:00100000:1.0:1788580996.073394:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014194176 00000100:00100000:1.0:1788580996.073452:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788580996.073464:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:6720:x1875463014194176:12345-0@lo:101: 00010000:00010000:1.0:1788580996.073479:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788580996.073493:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919044ca8000/0xf54e3944c2a6fe03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fdfc expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.073519:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca8000/0xf54e3944c2a6fe03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fdfc expref: 12 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.073546:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919044ca8000/0xf54e3944c2a6fe03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fdfc expref: 12 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.073556:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8000, rc 0) 00000100:00100000:1.0:1788580996.073610:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:6720:x1875463014194176:12345-0@lo:101: Request processed in 148us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580996.073616:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788580996.073790:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014194176:0@lo:101: 00010000:00010000:2.0:1788580996.073805:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fdfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe03 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580996.073814:0:6720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fdfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fe03 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788580996.073923:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014194304:0@lo:501: 00000100:00100000:2.0:1788580996.073953:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580996.073992:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff919042bdc540 going to sleep for 11 seconds 00000100:00100000:1.0:1788580996.074974:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014194304 00000100:00100000:1.0:1788580996.074984:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014194304 00000100:00100000:1.0:1788580996.075034:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788580996.075044:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:6720:x1875463014194304:12345-0@lo:501: 00000100:00100000:1.0:1788580996.075340:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:6720:x1875463014194304:12345-0@lo:501: Request processed in 298us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580996.075348:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788580996.075636:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014194304:0@lo:501: 00000100:00100000:3.0:1788580996.075680:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014194432:0@lo:503: 00000100:00100000:3.0:1788580996.075723:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580996.075759:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788580996.075870:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014194432 00000100:00100000:2.0:1788580996.075876:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014194432 00000100:00100000:2.0:1788580996.075911:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788580996.075919:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:6720:x1875463014194432:12345-0@lo:503: 00000100:00100000:2.0:1788580996.076320:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:6720:x1875463014194432:12345-0@lo:503: Request processed in 400us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580996.076327:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788580996.076571:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014194432:0@lo:503: 00000040:00080000:3.0:1788580996.076860:0:6720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788580996.076928:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014194560:0@lo:502: 00000100:00100000:3.0:1788580996.076973:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580996.077008:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788580996.077407:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014194560 00000100:00100000:2.0:1788580996.077414:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014194560 00000100:00100000:2.0:1788580996.077459:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788580996.077468:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:6720:x1875463014194560:12345-0@lo:502: 00000100:00100000:2.0:1788580996.077831:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:6720:x1875463014194560:12345-0@lo:502: Request processed in 364us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580996.077838:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788580996.078287:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014194560:0@lo:502: 00000040:00080000:3.0:1788580996.078874:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788580996.078936:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788580996.078973:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014194688:0@lo:502: 00000100:00100000:3.0:1788580996.079027:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580996.079279:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788580996.079937:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014194688 00000100:00100000:1.0:1788580996.079946:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014194688 00000100:00100000:1.0:1788580996.080036:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788580996.080046:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:6720:x1875463014194688:12345-0@lo:502: 00000100:00100000:1.0:1788580996.080305:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:6720:x1875463014194688:12345-0@lo:502: Request processed in 260us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580996.080312:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788580996.080514:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014194688:0@lo:502: 00010000:00010000:0.0:1788580996.080724:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788580996.080925:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788580996.080939:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788580996.081619:0:6745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788580996.081637:0:6745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788580996.081640:0:6745:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788580996.081646:0:6745:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91906c6c6000 00000020:00000080:3.0:1788580996.081649:0:6745:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788580996.081668:0:6745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788580996.081672:0:6745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788580996.081673:0:6745:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788580996.081676:0:6745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788580996.082326:0:6720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788580996.082353:0:6720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788580996.082406:0:6720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fdfc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe03 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580996.082418:0:6720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fdfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe03 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788580996.082459:0:6720:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788580996.082461:0:6720:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91906c6c6000 10000000:01000000:0.0:1788580996.082464:0:6720:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91906c6c6000 10000000:01000000:0.0:1788580996.082468:0:6720:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788580996.082473:0:6720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91906c6c6000 from 1 10000000:01000000:0.0:1788580996.082476:0:6720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788580996.082516:0:6720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a6fe0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580996.082523:0:6720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a6fe0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580996.082540:0:6720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a6fe0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788580996.082560:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014194816:0@lo:101: 00000100:00100000:0.0:1788580996.083031:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580996.083098:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff91904843d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788580996.087882:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014194816 00000100:00100000:1.0:1788580996.087900:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014194816 00000100:00100000:1.0:1788580996.087966:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788580996.087976:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:6720:x1875463014194816:12345-0@lo:101: 00010000:00010000:1.0:1788580996.087993:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788580996.088028:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919044ca9000/0xf54e3944c2a6fe11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fe0a expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.088055:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca9000/0xf54e3944c2a6fe11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fe0a expref: 13 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.088066:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919044ca9000/0xf54e3944c2a6fe11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fe0a expref: 13 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.088088:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9000, rc 0) 00000100:00100000:1.0:1788580996.088182:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:6720:x1875463014194816:12345-0@lo:101: Request processed in 207us (5150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580996.088189:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788580996.088729:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014194816:0@lo:101: 00010000:00010000:0.0:1788580996.088750:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a6fe0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe11 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580996.088767:0:6720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a6fe0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fe11 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788580996.088883:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014194944:0@lo:501: 00000100:00100000:0.0:1788580996.088918:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580996.088960:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff91904843d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788580996.089369:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014194944 00000100:00100000:1.0:1788580996.089383:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014194944 00000100:00100000:1.0:1788580996.089423:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788580996.089432:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:6720:x1875463014194944:12345-0@lo:501: 00000100:00100000:1.0:1788580996.089718:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:6720:x1875463014194944:12345-0@lo:501: Request processed in 287us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580996.089725:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788580996.089850:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014194944:0@lo:501: 00000100:00100000:3.0:1788580996.089885:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014195072:0@lo:503: 00000100:00100000:3.0:1788580996.089926:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580996.089958:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788580996.090348:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014195072 00000100:00100000:1.0:1788580996.090353:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014195072 00000100:00100000:1.0:1788580996.090388:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788580996.090396:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:6720:x1875463014195072:12345-0@lo:503: 00000100:00100000:1.0:1788580996.090559:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:6720:x1875463014195072:12345-0@lo:503: Request processed in 164us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580996.090565:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788580996.090741:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014195072:0@lo:503: 00000040:00080000:3.0:1788580996.090996:0:6720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788580996.091054:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014195200:0@lo:502: 00000100:00100000:3.0:1788580996.091101:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580996.091130:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788580996.091315:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014195200 00000100:00100000:1.0:1788580996.091320:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014195200 00000100:00100000:1.0:1788580996.091358:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788580996.091366:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:6720:x1875463014195200:12345-0@lo:502: 00000100:00100000:1.0:1788580996.091522:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:6720:x1875463014195200:12345-0@lo:502: Request processed in 156us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580996.091541:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788580996.091805:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014195200:0@lo:502: 00000040:00080000:3.0:1788580996.092036:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788580996.092094:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788580996.092124:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788580996.092164:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788580996.092196:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788580996.092289:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788580996.092324:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788580996.092351:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788580996.092391:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788580996.092424:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788580996.092460:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788580996.092505:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788580996.092566:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788580996.092600:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788580996.092789:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788580996.092824:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788580996.092850:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788580996.092899:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788580996.092931:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788580996.092964:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788580996.093013:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788580996.093044:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788580996.093336:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788580996.093392:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788580996.093428:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788580996.093473:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788580996.093521:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788580996.093824:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788580996.093871:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014195328:0@lo:502: 00000100:00100000:3.0:1788580996.093946:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580996.093990:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788580996.094173:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014195328 00000100:00100000:1.0:1788580996.094181:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014195328 00000100:00100000:1.0:1788580996.094277:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788580996.094287:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:6720:x1875463014195328:12345-0@lo:502: 00000100:00100000:1.0:1788580996.094494:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:6720:x1875463014195328:12345-0@lo:502: Request processed in 208us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580996.094501:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788580996.095962:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014195328:0@lo:502: 00000040:00080000:0.0:1788580996.096385:0:6720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788580996.096402:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788580996.097065:0:6746:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788580996.105779:0:6746:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff919046a68000) 00000020:00000080:3.0:1788580996.105811:0:6746:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788580996.105942:0:6746:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91906c6c6000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788580996.105947:0:6746:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91906c6c6000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788580996.105950:0:6746:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91906c6c6000 3 00010000:00080000:3.0:1788580996.105992:0:6746:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91907f95a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.113@tcp at head 00010000:00010000:3.0:1788580996.114272:0:6746:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788580996.114507:0:6746:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788580996.114738:0:6746:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788580996.114752:0:6746:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf54e3944c2a6fe1f 00000100:00080000:3.0:1788580996.114762:0:6746:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788580996.114767:0:6746:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91907f95a800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:3.0:1788580996.114802:0:6746:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91906c60f480 x1875463014195456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788580996.114825:0:6746:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788580996.121828:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3337:1875463014195456:0@lo:38: 00000100:00100000:1.0:1788580996.121919:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580996.122055:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3338:1875463014195584:0@lo:400: 00000100:00100000:2.0:1788580996.122191:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014195456 00000100:00100000:2.0:1788580996.122201:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014195456 00000100:00100000:1.0:1788580996.123534:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580996.127228:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014195584 00000100:00100000:2.0:1788580996.127265:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014195584 00000100:00100000:2.0:1788580996.127314:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788580996.127323:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3338:x1875463014195584:12345-0@lo:400: 00000100:00100000:2.0:1788580996.127417:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3338:x1875463014195584:12345-0@lo:400: Request processed in 91us (3892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580996.127425:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788580996.127446:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788580996.127450:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3337:x1875463014195456:12345-0@lo:38: 00010000:00080000:2.0:1788580996.127474:0:5878:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:2.0:1788580996.127508:0:5878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf54e3944c2a6fe26 00010000:00080000:0.0:1788580996.127682:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9190779cce00 x1875463014195584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788580996.127699:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3338:1875463014195584:0@lo:400: 00000004:00100000:2.0:1788580996.127823:0:5878:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788580996.127854:0:5878:0:(import.c:65:import_set_state_nolock()) ffff91907f8f3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788580996.127903:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3337:x1875463014195456:12345-0@lo:38: Request processed in 451us (5984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580996.127911:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788580996.129110:0:3337:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91906c60f480 x1875463014195456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788580996.129123:0:3337:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788580996.129132:0:3337:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788580996.129140:0:3337:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788580996.129259:0:3337:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788580996.129262:0:3337:0:(import.c:65:import_set_state_nolock()) ffff91907f95a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788580996.129270:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3337:1875463014195456:0@lo:38: 00000040:00080000:0.0:1788580996.134915:0:6746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788580996.135050:0:6720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788580996.135095:0:6720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788580996.135117:0:6720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a6fe0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe11 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580996.135138:0:6720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a6fe0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe11 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788580996.135194:0:6720:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788580996.135197:0:6720:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788580996.135198:0:6720:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788580996.135199:0:6720:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788580996.135200:0:6720:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788580996.135202:0:6720:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788580996.135203:0:6720:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788580996.135205:0:6720:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788580996.135215:0:6720:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788580996.135217:0:6720:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788580996.135218:0:6720:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788580996.135222:0:6720:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788580996.135225:0:6720:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788580996.135226:0:6720:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788580996.135227:0:6720:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788580996.135228:0:6720:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788580996.135229:0:6720:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788580996.135230:0:6720:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788580996.135232:0:6720:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788580996.135233:0:6720:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788580996.135234:0:6720:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788580996.135235:0:6720:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788580996.135236:0:6720:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788580996.135284:0:6720:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788580996.135304:0:6720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014195712:0@lo:253: 00000100:00100000:0.0:1788580996.135375:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580996.135416:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014195712 00000100:00100000:0.0:1788580996.135424:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014195712 00000100:00100000:0.0:1788580996.135469:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788580996.135478:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:6720:x1875463014195712:12345-0@lo:253: 20000000:01000000:0.0:1788580996.135523:0:5869:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788580996.135808:0:5869:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788580996.136781:0:6720:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f411ea9c0 going to sleep for 11 seconds 20000000:01000000:1.0:1788580996.171106:0:5869:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788580996.171129:0:5869:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788580996.171459:0:5892:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788580996.171465:0:5892:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788580996.171490:0:5892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe2d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580996.171508:0:5892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919044ca9a00/0xf54e3944c2a6fd85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fd7e expref: 13 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580996.171517:0:5892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe2d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580996.171572:0:5892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919044ca9a00/0xf54e3944c2a6fd85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6fd7e expref: 13 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580996.171587:0:5892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919044ca9a00/0xf54e3944c2a6fd85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd7e expref: 13 pid: 5869 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788580996.171602:0:5892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5892:1875463014195840:0@lo:104: 00000100:00100000:0.0:1788580996.171683:0:5892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580996.171757:0:5892:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f411ea0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788580996.172018:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014195840 00000100:00100000:1.0:1788580996.172026:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014195840 00000100:00100000:1.0:1788580996.172087:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788580996.172097:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:5892:x1875463014195840:12345-0@lo:104: 00010000:00010000:1.0:1788580996.172109:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff919040030a00/0xf54e3944c2a6fd7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fd85 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.172167:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788580996.172173:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:5892:x1875463014195840:12345-0@lo:104: Request processed in 79us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580996.172196:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788580996.172227:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788580996.172232:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919040030a00/0xf54e3944c2a6fd7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fd85 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.172238:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040030a00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:1.0:1788580996.172269:0:5865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919040030a00/0xf54e3944c2a6fd7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6fd85 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.172278:0:5865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919040030a00/0xf54e3944c2a6fd7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6fd85 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788580996.172285:0:5865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919040030a00/0xf54e3944c2a6fd7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6fd85 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788580996.172290:0:5865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788580996.172319:0:5865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919040030a00/0xf54e3944c2a6fd7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fd85 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.172324:0:5865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788580996.172342:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919040030a00/0xf54e3944c2a6fd7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fd85 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.172347:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919040030a00/0xf54e3944c2a6fd7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fd85 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.172376:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788580996.172378:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788580996.172379:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788580996.172398:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014195968:0@lo:103: 00000100:00100000:1.0:1788580996.172437:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580996.172481:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014195968 00000100:00100000:1.0:1788580996.172485:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014195968 00010000:00010000:1.0:1788580996.172503:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919044ca9a00/0xf54e3944c2a6fd85 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd7e expref: 14 pid: 5869 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788580996.172744:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788580996.172755:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:3339:x1875463014195968:12345-0@lo:103: 00010000:00010000:1.0:1788580996.172766:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788580996.172771:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919044ca9a00/0xf54e3944c2a6fd85 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd7e expref: 14 pid: 5869 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.172782:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919044ca9a00/0xf54e3944c2a6fd85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd7e expref: 14 pid: 5869 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.172799:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe2d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.172807:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe2d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788580996.172819:0:5861:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001526076s 00010000:00010000:1.0:1788580996.172824:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.172831:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.172838:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe2d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.172854:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.172859:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040031e00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788580996.172862:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.172869:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe2d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.172879:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe2d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.172889:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788580996.172932:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:3339:x1875463014195968:12345-0@lo:103: Request processed in 180us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580996.172940:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788580996.173015:0:5892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919044ca9a00/0xf54e3944c2a6fd85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6fd7e expref: 13 pid: 5869 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788580996.173027:0:5892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5892:1875463014195840:0@lo:104: 00010000:00010000:1.0:1788580996.173043:0:5892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.173050:0:5892:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.173056:0:5892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580996.173071:0:5892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe2d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788580996.173139:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014195968:0@lo:103: 00000100:00100000:2.0:1788580996.184676:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:6720:x1875463014195712:12345-0@lo:253: Request processed in 49185us (49288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580996.184692:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788580996.184838:0:6720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6720:1875463014195712:0@lo:253: 10000000:01000000:0.0:1788580996.184855:0:6720:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788580996.184859:0:6720:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788580996.184861:0:6720:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788580996.184862:0:6720:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788580996.184863:0:6720:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788580996.184865:0:6720:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788580996.184866:0:6720:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788580996.184868:0:6720:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788580996.184869:0:6720:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788580996.184870:0:6720:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788580996.184872:0:6720:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788580996.184891:0:6720:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788580996.184909:0:6720:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788580996.190504:0:6720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788580996.190848:0:6720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788580996.191170:0:6720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788580996.191404:0:6720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788580996.191830:0:6720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788580996.192199:0:6720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788580996.193754:0:6720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788580996.435575:0:6720:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788580996.435583:0:6720:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788580996.435942:0:6720:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788580996.436097:0:6720:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788580996.436183:0:6720:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788580996.436226:0:6720:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788580997.104668:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788580998.064307:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788580998.064316:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91904733b800 from 21 10000000:01000000:1.0:1788580998.064321:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788580998.064363:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a6fe34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580998.064374:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a6fe34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580998.064385:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a6fe34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788580998.064408:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014196096:0@lo:101: 00000100:00100000:1.0:1788580998.064472:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580998.064519:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91905fd89900 going to sleep for 11 seconds 00000100:00100000:1.0:1788580998.064541:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014196096 00000100:00100000:1.0:1788580998.064549:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014196096 00000100:00100000:1.0:1788580998.064745:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788580998.064755:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5874:x1875463014196096:12345-0@lo:101: 00010000:00010000:1.0:1788580998.064767:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788580998.064777:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919044ca9800/0xf54e3944c2a6fe3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fe34 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580998.064799:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca9800/0xf54e3944c2a6fe3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fe34 expref: 13 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580998.064816:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919044ca9800/0xf54e3944c2a6fe3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fe34 expref: 13 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580998.064825:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9800, rc 0) 00000100:00100000:1.0:1788580998.064859:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:5874:x1875463014196096:12345-0@lo:101: Request processed in 106us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580998.064866:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788580998.064906:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014196096:0@lo:101: 00010000:00010000:1.0:1788580998.064919:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a6fe34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe3b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580998.064927:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a6fe34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fe3b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788580998.064986:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014196224:0@lo:501: 00000100:00100000:1.0:1788580998.065009:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580998.065027:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91905fd89900 going to sleep for 11 seconds 00000100:00100000:1.0:1788580998.065057:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014196224 00000100:00100000:1.0:1788580998.065061:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014196224 00000100:00100000:1.0:1788580998.065080:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788580998.065086:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:5874:x1875463014196224:12345-0@lo:501: 00000100:00100000:1.0:1788580998.065347:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:5874:x1875463014196224:12345-0@lo:501: Request processed in 260us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580998.065353:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788580998.065379:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014196224:0@lo:501: 00000100:00100000:1.0:1788580998.065402:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014196352:0@lo:503: 00000100:00100000:1.0:1788580998.065438:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580998.065450:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91905fd89900 going to sleep for 11 seconds 00000100:00100000:1.0:1788580998.065460:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014196352 00000100:00100000:1.0:1788580998.065463:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014196352 00000100:00100000:1.0:1788580998.065482:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788580998.065487:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:5874:x1875463014196352:12345-0@lo:503: 00000100:00100000:1.0:1788580998.066097:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:5874:x1875463014196352:12345-0@lo:503: Request processed in 607us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580998.066105:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788580998.070326:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014196352:0@lo:503: 00000100:00100000:0.0:1788580998.072968:0:6816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6816:1875463014196480:0@lo:502: 00000100:00100000:0.0:1788580998.073048:0:6816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580998.073103:0:6816:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f411ea840 going to sleep for 11 seconds 00000100:00100000:2.0:1788580998.073225:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014196480 00000100:00100000:2.0:1788580998.073232:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014196480 00000100:00100000:2.0:1788580998.073287:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788580998.073296:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:6816:x1875463014196480:12345-0@lo:502: 00000100:00100000:2.0:1788580998.073533:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:6816:x1875463014196480:12345-0@lo:502: Request processed in 237us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580998.073541:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788580998.076324:0:6816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6816:1875463014196480:0@lo:502: 00000100:00100000:0.0:1788580998.076403:0:6816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6816:1875463014196608:0@lo:502: 00000100:00100000:0.0:1788580998.076471:0:6816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580998.078215:0:6816:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f411ea840 going to sleep for 11 seconds 00000100:00100000:2.0:1788580998.085741:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014196608 00000100:00100000:2.0:1788580998.085758:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014196608 00000100:00100000:2.0:1788580998.085844:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788580998.085856:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:6816:x1875463014196608:12345-0@lo:502: 00000100:00100000:2.0:1788580998.086161:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:6816:x1875463014196608:12345-0@lo:502: Request processed in 307us (9689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580998.086169:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788580998.086567:0:6816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6816:1875463014196608:0@lo:502: 00000040:00080000:0.0:1788580998.086613:0:6816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788580998.087411:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788580998.087436:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788580998.087446:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a6fe34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe3b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580998.087476:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a6fe34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe3b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788580998.087488:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788580998.087491:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91904733b800 from 4 10000000:01000000:2.0:1788580998.087494:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788580998.087530:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6fe42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580998.087538:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6fe42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788580998.087548:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6fe42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788580998.088090:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048583800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014196736:0@lo:101: 00000100:00100000:2.0:1788580998.088156:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580998.089931:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485ce0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788580998.090419:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014196736 00000100:00100000:0.0:1788580998.090430:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014196736 00000100:00100000:0.0:1788580998.090488:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788580998.090498:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:5874:x1875463014196736:12345-0@lo:101: 00010000:00010000:0.0:1788580998.090532:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788580998.090551:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fe42 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580998.090579:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fe42 expref: 14 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580998.090605:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fe42 expref: 14 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788580998.090614:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919040031e00, rc 0) 00000100:00100000:0.0:1788580998.090685:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:5874:x1875463014196736:12345-0@lo:101: Request processed in 188us (2529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580998.090691:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788580998.090842:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048583800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014196736:0@lo:101: 00010000:00010000:3.0:1788580998.090860:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6fe42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe49 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580998.090879:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6fe42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fe49 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788580998.090940:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014196864:0@lo:256: 00000100:00100000:3.0:1788580998.090975:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580998.091007:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788580998.091106:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014196864 00000100:00100000:0.0:1788580998.091110:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014196864 00000100:00100000:0.0:1788580998.091136:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788580998.091143:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:5874:x1875463014196864:12345-0@lo:256: 20000000:01000000:0.0:1788580998.091156:0:5869:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788580998.091172:0:5869:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788580998.091187:0:5869:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788580998.091302:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:5874:x1875463014196864:12345-0@lo:256: Request processed in 159us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580998.091309:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788580998.091459:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014196864:0@lo:256: 10000000:01000000:3.0:1788580998.091502:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788580998.091510:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6fe42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe49 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580998.091518:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6fe42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe49 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788580998.091527:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788580998.091530:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788580998.091534:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788580998.091553:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190414b2800/0xf54e3944c2a6fe50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580998.091560:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff9190414b2800/0xf54e3944c2a6fe50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580998.091569:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff9190414b2800/0xf54e3944c2a6fe50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788580998.091581:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014196992:0@lo:101: 00000100:00100000:3.0:1788580998.091631:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580998.091647:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788580998.091659:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014196992 00000100:00100000:3.0:1788580998.091663:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014196992 00000100:00100000:3.0:1788580998.091685:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788580998.091692:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:5874:x1875463014196992:12345-0@lo:101: 00010000:00010000:3.0:1788580998.091699:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788580998.091708:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6fe57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fe50 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580998.091721:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6fe57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fe50 expref: 15 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580998.091729:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6fe57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fe50 expref: 15 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580998.091737:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190414b3400, rc 0) 00000100:00100000:3.0:1788580998.091763:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014196992:12345-0@lo:101: Request processed in 72us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580998.091769:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788580998.091798:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014196992:0@lo:101: 00010000:00010000:3.0:1788580998.091807:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff9190414b2800/0xf54e3944c2a6fe50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe57 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580998.091815:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff9190414b2800/0xf54e3944c2a6fe50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fe57 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788580998.092347:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014197120:0@lo:501: 00000100:00100000:3.0:1788580998.092384:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580998.092404:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788580998.092455:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014197120 00000100:00100000:0.0:1788580998.092460:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014197120 00000100:00100000:0.0:1788580998.092491:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788580998.092497:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014197120:12345-0@lo:501: 00000100:00100000:0.0:1788580998.093086:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014197120:12345-0@lo:501: Request processed in 586us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788580998.093100:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788580998.096848:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014197120:0@lo:501: 00000100:00100000:3.0:1788580998.096909:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014197248:0@lo:503: 00000100:00100000:3.0:1788580998.096995:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580998.100468:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788580998.100571:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014197248 00000100:00100000:1.0:1788580998.100580:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014197248 00000100:00100000:1.0:1788580998.101478:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788580998.101493:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014197248:12345-0@lo:503: 00000100:00100000:1.0:1788580998.101797:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014197248:12345-0@lo:503: Request processed in 308us (4801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580998.101805:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788580998.101933:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014197248:0@lo:503: 00000100:00100000:0.0:1788580998.105856:0:6819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6819:1875463014197376:0@lo:502: 00000100:00100000:0.0:1788580998.105951:0:6819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580998.106055:0:6819:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f411eae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788580998.109352:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014197376 00000100:00100000:3.0:1788580998.109440:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014197376 00000100:00100000:3.0:1788580998.109512:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788580998.109523:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:6819:x1875463014197376:12345-0@lo:502: 00000100:00100000:3.0:1788580998.109862:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:6819:x1875463014197376:12345-0@lo:502: Request processed in 340us (3909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580998.109869:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788580998.109982:0:6819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6819:1875463014197376:0@lo:502: 00000020:01000000:0.0:1788580998.110018:0:6819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788580998.110025:0:6819:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788580998.110032:0:6819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788580998.110035:0:6819:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788580998.110040:0:6819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788580998.110044:0:6819:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.113@tcp to nid 0x20000c0a8c971 (192.168.201.113@tcp) 00000020:01000000:0.0:1788580998.110064:0:6819:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788580998.110067:0:6819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788580998.110094:0:6819:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff919076214d28) 00000020:00000080:0.0:1788580998.110115:0:6819:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788580998.110123:0:6819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788580998.110218:0:6819:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788580998.110224:0:6819:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788580998.110231:0:6819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf54e3944c2a6fe65 00010000:00080000:0.0:1788580998.110295:0:6819:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919048414000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.113@tcp at head 00010000:00010000:0.0:1788580998.110542:0:6819:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:0.0:1788580998.128444:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788580998.169564:0:6819:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788580998.169596:0:6819:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788580998.171445:0:6819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788580998.171759:0:6819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788580998.171811:0:6819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788580998.171874:0:6819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788580998.172293:0:6820:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788580998.172298:0:6820:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788580998.173010:0:6819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788580998.173022:0:6819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788580998.173056:0:6819:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788580998.173074:0:6819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf54e3944c2a6fe6c 00000100:00080000:2.0:1788580998.173083:0:6819:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788580998.173087:0:6819:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff919048414000 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:2.0:1788580998.173114:0:6819:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919048581f80 x1875463014197504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788580998.173134:0:6819:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788580998.173542:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014197504:0@lo:8: 00000100:00100000:0.0:1788580998.173613:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580998.173675:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014197504 00000100:00100000:1.0:1788580998.173682:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014197504 00000100:00100000:1.0:1788580998.173716:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788580998.173723:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3337:x1875463014197504:12345-0@lo:8: 00010000:00080000:1.0:1788580998.173747:0:6722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1788580998.173771:0:6722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf54e3944c2a6fe73 00002000:00100000:1.0:1788580998.173801:0:6722:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91907fbfa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788580998.173806:0:6722:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788580998.173809:0:6722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788580998.173905:0:6722:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:2.0:1788580998.174011:0:6819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1788580998.174024:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3341:1875463014197760:0@lo:400: 00000100:00100000:2.0:1788580998.174059:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580998.174094:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788580998.174099:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014197632:0@lo:400: 00002000:00080000:1.0:1788580998.174103:0:6722:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1788580998.174119:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788580998.174124:0:6722:0:(import.c:65:import_set_state_nolock()) ffff91907fbfc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788580998.174145:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014197760 00000100:00100000:2.0:1788580998.174148:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014197760 00000100:00100000:1.0:1788580998.174165:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3337:x1875463014197504:12345-0@lo:8: Request processed in 442us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580998.174188:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788580998.174992:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788580998.175031:0:3337:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919048581f80 x1875463014197504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788580998.175057:0:3337:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788580998.175063:0:3337:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788580998.175069:0:3337:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788580998.175072:0:3337:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788580998.175075:0:3337:0:(import.c:65:import_set_state_nolock()) ffff919048414000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788580998.175088:0:3337:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788580998.175093:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014197504:0@lo:8: 00000100:00100000:3.0:1788580998.181012:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014197632 00000100:00100000:3.0:1788580998.181028:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014197632 00000100:00100000:3.0:1788580998.181089:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788580998.181100:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3341:x1875463014197760:12345-0@lo:400: 00000100:00100000:3.0:1788580998.181225:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3341:x1875463014197760:12345-0@lo:400: Request processed in 126us (7163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580998.181232:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788580998.181266:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788580998.181274:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014197632:12345-0@lo:400: 00000100:00100000:3.0:1788580998.181303:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014197632:12345-0@lo:400: Request processed in 31us (7183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788580998.181309:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:00000080:3.0:1788580998.191339:0:6819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788580998.191348:0:6819:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788580998.191359:0:6819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788580998.191366:0:6819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788580998.191368:0:6819:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788580998.191372:0:6819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788580998.191374:0:6819:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788580998.191420:0:6819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6819:1875463014197888:0@lo:502: 00000100:00100000:3.0:1788580998.191510:0:6819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580998.191550:0:6819:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048c8f000 going to sleep for 11 seconds 00000004:00080000:3.0:1788580998.191570:0:6820:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788580998.191630:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014197888 00000100:00100000:1.0:1788580998.191638:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014197888 00000100:00100000:1.0:1788580998.191678:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788580998.191686:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:6819:x1875463014197888:12345-0@lo:502: 00000004:00080000:3.0:1788580998.191735:0:6820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 214432490775ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788580998.191900:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:6819:x1875463014197888:12345-0@lo:502: Request processed in 213us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580998.191907:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788580998.191971:0:6819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:6819:1875463014197888:0@lo:502: 00000020:01000000:1.0:1788580998.191995:0:6819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788580998.192000:0:6819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788580998.192001:0:6819:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788580998.192005:0:6819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788580998.192154:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788580998.192184:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788580998.192195:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190414b2800/0xf54e3944c2a6fe50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe57 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580998.192206:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff9190414b2800/0xf54e3944c2a6fe50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe57 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788580998.192217:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788580998.192220:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff919047dccd28 from 1 10000000:01000000:3.0:1788580998.192223:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788580998.192262:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190414b2e00/0xf54e3944c2a6fe7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580998.192271:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff9190414b2e00/0xf54e3944c2a6fe7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788580998.192279:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff9190414b2e00/0xf54e3944c2a6fe7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788580998.192304:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014198016:0@lo:101: 00000100:00100000:3.0:1788580998.192331:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788580998.192349:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048c8fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788580998.192546:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014198016 00000100:00100000:1.0:1788580998.192551:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014198016 00000100:00100000:1.0:1788580998.192577:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788580998.192583:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014198016:12345-0@lo:101: 00010000:00010000:1.0:1788580998.192601:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788580998.192612:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6fe81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fe7a expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580998.192632:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6fe81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fe7a expref: 16 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580998.192642:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6fe81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fe7a expref: 16 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580998.192658:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9c00, rc 0) 00000100:00100000:1.0:1788580998.192690:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014198016:12345-0@lo:101: Request processed in 107us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580998.192696:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788580998.192724:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014198016:0@lo:101: 00010000:00010000:1.0:1788580998.192734:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff9190414b2e00/0xf54e3944c2a6fe7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe81 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580998.192743:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff9190414b2e00/0xf54e3944c2a6fe7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fe81 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788580998.192785:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014198144:0@lo:501: 00000100:00100000:1.0:1788580998.192808:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580998.192821:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91905fd89900 going to sleep for 11 seconds 00000100:00100000:1.0:1788580998.192833:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014198144 00000100:00100000:1.0:1788580998.192836:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014198144 00000100:00100000:1.0:1788580998.192856:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788580998.192863:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014198144:12345-0@lo:501: 00000100:00100000:1.0:1788580998.193207:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014198144:12345-0@lo:501: Request processed in 343us (397us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788580998.193214:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788580998.193260:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014198144:0@lo:501: 10000000:01000000:1.0:1788580998.193282:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788580998.193287:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190414b2e00/0xf54e3944c2a6fe7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe81 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788580998.193305:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff9190414b2e00/0xf54e3944c2a6fe7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fe81 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788580998.195303:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91906c60ce00 x1875463014197632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788580998.195320:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014197632:0@lo:400: 00010000:00080000:1.0:1788580998.195332:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91906c60f100 x1875463014197760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788580998.195340:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3341:1875463014197760:0@lo:400: 00000004:00080000:0.0:1788580998.300463:0:6821:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788580998.300500:0:6821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6821:1875463014198400:0@lo:7: 00000100:00100000:0.0:1788580998.300900:0:6821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788580998.300983:0:6821:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f411ea240 going to sleep for 11 seconds 00000100:00100000:2.0:1788580998.301076:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014198400 00000100:00100000:2.0:1788580998.301084:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014198400 00000100:00100000:2.0:1788580998.301149:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788580998.301161:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788580998.301162:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6821:x1875463014198400:12345-0@lo:7: 00000100:00100000:1.0:1788580998.303277:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014198272:0@lo:13: 00000100:00100000:1.0:1788580998.303361:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580998.303811:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014198272 00000100:00100000:1.0:1788580998.303821:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014198272 00000100:00100000:1.0:1788580998.303945:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788580998.303956:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3338:x1875463014198272:12345-0@lo:13: 00002000:00000024:1.0:1788580998.303985:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788580998.304037:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3338:x1875463014198272:12345-0@lo:13: Request processed in 82us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580998.304044:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788580998.304100:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919075b76680 x1875463014198272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788580998.304121:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014198272:0@lo:13: 00002000:00080000:2.0:1788580998.314483:0:6725:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788580998.314493:0:6725:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788580998.315826:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6821:x1875463014198400:12345-0@lo:7: Request processed in 14659us (15230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580998.315841:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788580998.316048:0:6821:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919075b74e00 x1875463014198400/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788581014 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788580998.316063:0:6821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6821:1875463014198400:0@lo:7: 00000004:00080000:2.0:1788580998.316078:0:6821:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788580998.316142:0:6821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048582a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6821:1875463014198528:0@lo:5: 00000100:00100000:2.0:1788580998.316205:0:6821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580998.319211:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014198528 00000100:00100000:2.0:1788580998.319233:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014198528 00000100:00100000:2.0:1788580998.319317:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788580998.319327:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6821:x1875463014198528:12345-0@lo:5: 00002000:00080000:2.0:1788580998.319370:0:6722:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788580998.319375:0:6722:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788580998.319924:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6821:x1875463014198528:12345-0@lo:5: Request processed in 597us (3717us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788580998.319932:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788580998.320084:0:6821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485cef00 going to sleep for 11 seconds 00010000:00080000:2.0:1788580998.320116:0:6821:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919048582a00 x1875463014198528/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581014 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788580998.320132:0:6821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048582a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6821:1875463014198528:0@lo:5: 00000004:00080000:2.0:1788580998.320145:0:6821:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788580998.320199:0:6821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6821:1875463014198656:0@lo:700: 00000100:00100000:2.0:1788580998.320236:0:6821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580998.320345:0:6731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014198656 00000100:00100000:2.0:1788580998.320351:0:6731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014198656 00000100:00100000:2.0:1788580998.320552:0:6731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788580998.320563:0:6731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6821:x1875463014198656:12345-0@lo:700: 00000100:00100000:2.0:1788580998.320683:0:6731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048583480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6731:1875463014198784:0@lo:700: 00000100:00100000:2.0:1788580998.320713:0:6731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788580998.320740:0:6731:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485ce000 going to sleep for 11 seconds 00000100:00100000:2.0:1788580998.320757:0:6821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485cef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788580998.322776:0:5883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014198784 00000100:00100000:1.0:1788580998.322797:0:5883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014198784 00000100:00100000:1.0:1788580998.323086:0:5883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788580998.323099:0:5883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6731:x1875463014198784:12345-0@lo:700: 00000004:00080000:1.0:1788580998.360521:0:5899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:1.0:1788580998.414729:0:5883:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788580998.423228:0:5883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6731:x1875463014198784:12345-0@lo:700: Request processed in 100123us (102504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788580998.423254:0:5883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788580998.425758:0:6731:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919048583480 x1875463014198784/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788581014 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788580998.425775:0:6731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048583480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6731:1875463014198784:0@lo:700: 40000000:02000000:3.0:1788580998.425790:0:6731:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:3.0:1788580998.512543:0:6750:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788580998.512561:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1788580998.512850:0:6731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6821:x1875463014198656:12345-0@lo:700: Request processed in 192282us (192605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788580998.512862:0:6731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788580998.516220:0:6821:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919048581f80 x1875463014198656/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788581014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788580998.516237:0:6821:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788580998.516730:0:6821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6821:1875463014198656:0@lo:700: 00000004:02000040:1.0:1788580998.605125:0:6821:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788580998.611302:0:6821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6821:1875463014198912:0@lo:5: 00000100:00100000:1.0:1788580998.611377:0:6821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788580998.611428:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014198912 00000100:00100000:1.0:1788580998.611437:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014198912 00000100:00100000:1.0:1788580998.611486:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788580998.611495:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6821:x1875463014198912:12345-0@lo:5: 00000100:00100000:0.0:1788580998.622975:0:6821:0:(client.c:2715:ptlrpc_set_wait()) set ffff919072187a80 going to sleep for 11 seconds 00002000:00080000:1.0:1788580998.627446:0:6723:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788580998.627466:0:6723:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788580998.632027:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6821:x1875463014198912:12345-0@lo:5: Request processed in 20526us (20642us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788580998.632039:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788580998.640413:0:6821:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9190779ced80 x1875463014198912/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788580998.640434:0:6821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6821:1875463014198912:0@lo:5: 00000004:00080000:2.0:1788580998.640449:0:6821:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788580999.153615:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581000.177422:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581001.201623:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581002.224801:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581003.253385:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581003.375436:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581003.375463:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014199040:0@lo:13: 00000100:00100000:0.0:1788581003.375546:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581003.375779:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014199040 00000100:00100000:1.0:1788581003.375787:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014199040 00000100:00100000:1.0:1788581003.375857:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581003.375867:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014199040:12345-0@lo:13: 00002000:00000024:1.0:1788581003.375902:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581003.375960:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014199040:12345-0@lo:13: Request processed in 95us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581003.375966:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788581003.376029:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788581003.376058:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9190779cdf80 x1875463014199040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581003.376077:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014199040:0@lo:13: 00000100:00100000:0.0:1788581003.376298:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014199296:0@lo:400: 00000100:00100000:0.0:1788581003.376325:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581003.376344:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581003.376349:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014199168:0@lo:400: 00000100:00100000:0.0:1788581003.376371:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581003.376398:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014199168 00000100:00100000:0.0:1788581003.376402:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014199168 00000100:00100000:0.0:1788581003.376426:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788581003.376431:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:3341:x1875463014199168:12345-0@lo:400: 00000100:00100000:0.0:1788581003.376462:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:3341:x1875463014199168:12345-0@lo:400: Request processed in 31us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581003.376468:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788581003.376511:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014199168:0@lo:400: 00000100:00100000:0.0:1788581003.376526:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014199424:0@lo:400: 00000100:00100000:0.0:1788581003.376546:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581003.376787:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014199296 00000100:00100000:3.0:1788581003.376792:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014199296 00000100:00100000:3.0:1788581003.376825:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014199424 00000100:00100000:3.0:1788581003.376828:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014199424 00000100:00100000:3.0:1788581003.376856:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788581003.376862:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014199296:12345-0@lo:400: 00000100:00100000:3.0:1788581003.376904:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014199296:12345-0@lo:400: Request processed in 43us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581003.376909:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788581003.376924:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788581003.376929:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014199424:12345-0@lo:400: 00000100:00100000:3.0:1788581003.376956:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014199424:12345-0@lo:400: Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581003.376961:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788581003.377007:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919075b75880 x1875463014199296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581003.377035:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014199296:0@lo:400: 00000100:00080000:0.0:1788581003.377129:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788581003.377151:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919075b76d80 x1875463014199424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581003.377160:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014199424:0@lo:400: 00000001:00080000:3.0:1788581004.028045:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:02000400:0.0:1788581004.162050:0:7095:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788581004.272919:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581005.297502:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581006.319579:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581007.343403:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581008.369483:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581008.495686:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014199936:0@lo:400: 00000100:00100000:0.0:1788581008.495769:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581008.495869:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581008.495876:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014199552:0@lo:400: 00000100:00100000:0.0:1788581008.495920:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581008.495957:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014199680:0@lo:400: 00000100:00100000:0.0:1788581008.496008:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581008.496189:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014200064:0@lo:13: 00000100:00100000:2.0:1788581008.496218:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581008.496284:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014199552 00000100:00100000:2.0:1788581008.496290:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014199552 00000100:00100000:2.0:1788581008.496324:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788581008.496330:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:3338:x1875463014199552:12345-0@lo:400: 00000100:00100000:2.0:1788581008.496361:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:3338:x1875463014199552:12345-0@lo:400: Request processed in 32us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581008.496366:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788581008.496387:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014199936 00000100:00100000:2.0:1788581008.496389:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014199936 00000100:00100000:2.0:1788581008.496420:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581008.496424:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014199936:12345-0@lo:400: 00000100:00100000:2.0:1788581008.496444:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014199936:12345-0@lo:400: Request processed in 20us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581008.496447:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581008.496478:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014199552:0@lo:400: 00010000:00080000:2.0:1788581008.496488:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919075b74e00 x1875463014199936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581008.496504:0:3338:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788581008.496516:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014199936:0@lo:400: 00000100:00080000:2.0:1788581008.496534:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581008.496578:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014200064 00000100:00100000:1.0:1788581008.496581:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014200064 00000100:00100000:1.0:1788581008.496609:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581008.496617:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014200064:12345-0@lo:13: 00002000:00000024:1.0:1788581008.496643:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581008.496687:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014200064:12345-0@lo:13: Request processed in 72us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581008.496691:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788581008.496710:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9190779cca80 x1875463014200064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581008.496720:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014200064:0@lo:13: 00000100:00100000:3.0:1788581008.496798:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3341:1875463014199808:0@lo:400: 00000100:00100000:1.0:1788581008.498082:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581008.498359:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014199680 00000100:00100000:3.0:1788581008.498366:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014199680 00000100:00100000:3.0:1788581008.498407:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014199808 00000100:00100000:3.0:1788581008.498410:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014199808 00000100:00100000:3.0:1788581008.498443:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581008.498451:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014199680:12345-0@lo:400: 00000100:00100000:3.0:1788581008.498509:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014199680:12345-0@lo:400: Request processed in 59us (2511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581008.498517:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581008.498533:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581008.498538:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3341:x1875463014199808:12345-0@lo:400: 00000100:00100000:3.0:1788581008.498572:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3341:x1875463014199808:12345-0@lo:400: Request processed in 34us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581008.498577:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788581008.498612:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919075b75880 x1875463014199808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581008.498624:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3341:1875463014199808:0@lo:400: 00010000:00080000:3.0:1788581008.498652:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919075b75f80 x1875463014199680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788581008.498882:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581008.498974:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014199680:0@lo:400: 00010000:00010000:0.0:1788581009.402858:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581010.422064:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581011.439714:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581012.467038:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581013.489139:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581013.615512:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581013.618461:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014200320:0@lo:400: 00000100:00100000:1.0:1788581013.618619:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581013.618671:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014200192:0@lo:400: 00000100:00100000:1.0:1788581013.618696:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581013.618776:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014200320 00000100:00100000:1.0:1788581013.618785:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014200320 00000100:00100000:1.0:1788581013.618847:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581013.618856:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014200320:12345-0@lo:400: 00000100:00100000:1.0:1788581013.618907:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014200320:12345-0@lo:400: Request processed in 52us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581013.618924:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581013.618948:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014200192 00000100:00100000:1.0:1788581013.618951:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014200192 00000100:00100000:1.0:1788581013.618974:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788581013.618979:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:3341:x1875463014200192:12345-0@lo:400: 00000100:00100000:1.0:1788581013.619007:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:3341:x1875463014200192:12345-0@lo:400: Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581013.619013:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788581013.619040:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014200448:0@lo:13: 00000100:00100000:1.0:1788581013.619063:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581013.619100:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014200448 00000100:00100000:1.0:1788581013.619104:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014200448 00000100:00100000:1.0:1788581013.619137:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581013.619143:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014200448:12345-0@lo:13: 00002000:00000024:1.0:1788581013.619170:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581013.619201:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014200448:12345-0@lo:13: Request processed in 59us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581013.619207:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788581013.619222:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788581013.620415:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9190779cea00 x1875463014200448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581013.620439:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014200448:0@lo:13: 00010000:00080000:1.0:1788581013.620478:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919075b76300 x1875463014200320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581013.620703:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014200320:0@lo:400: 00000100:00100000:1.0:1788581013.620720:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014200192:0@lo:400: 00000100:00100000:1.0:1788581013.625736:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014200576:0@lo:400: 00000100:00100000:1.0:1788581013.625807:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581013.628152:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014200576 00000100:00100000:2.0:1788581013.628165:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014200576 00000100:00080000:1.0:1788581013.628576:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581013.628611:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581013.628625:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014200576:12345-0@lo:400: 00000100:00100000:2.0:1788581013.628741:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014200576:12345-0@lo:400: Request processed in 119us (2934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581013.628749:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788581013.632530:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919075b75500 x1875463014200576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581013.632548:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014200576:0@lo:400: 00010000:00010000:3.0:1788581014.521512:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581015.536729:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788581016.339496:0:7675:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788581016.339502:0:7675:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788581016.339653:0:7675:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91907f8f1000 00000020:01000004:2.0:1788581016.339673:0:7675:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788581016.339689:0:7675:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788581016.339705:0:7675:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9190464719b8) 00000020:00000080:2.0:1788581016.339725:0:7675:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788581016.360661:0:7675:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788581016.360939:0:7675:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788581016.386594:0:7675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788581016.393786:0:7675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788581016.393833:0:7675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788581016.393915:0:7675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788581016.393948:0:7675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788581016.395140:0:7675:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788581016.395156:0:7675:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788581016.395171:0:7675:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf54e3944c2a6fe8f 00000020:01000004:3.0:1788581016.395183:0:7675:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788581016.395210:0:7675:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788581016.395215:0:7675:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788581016.395222:0:7675:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788581016.395277:0:7675:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788581016.395282:0:7675:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788581016.428616:0:7675:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788581016.428675:0:7675:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.113@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788581016.428726:0:7675:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788581016.428728:0:7675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788581016.428730:0:7675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581016.428731:0:7675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581016.428732:0:7675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581016.428734:0:7675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581016.428735:0:7675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581016.428737:0:7675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788581016.428739:0:7675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788581016.428741:0:7675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581016.428743:0:7675:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788581016.428747:0:7675:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788581016.428750:0:7675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788581016.428752:0:7675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788581016.428753:0:7675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581016.428754:0:7675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581016.428756:0:7675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581016.428757:0:7675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581016.428758:0:7675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581016.428759:0:7675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788581016.428760:0:7675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788581016.428767:0:7675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581016.428768:0:7675:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788581016.428808:0:7675:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788581016.428835:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014200704:0@lo:253: 00000100:00100000:1.0:1788581016.428952:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581016.429113:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907b92db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581016.429484:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014200704 00000100:00100000:2.0:1788581016.429495:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014200704 00000100:00100000:2.0:1788581016.429607:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788581016.429619:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:7675:x1875463014200704:12345-0@lo:253: 20000000:01000000:2.0:1788581016.429661:0:5869:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788581016.429666:0:5869:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788581016.429673:0:5869:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788581016.429689:0:5869:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788581016.434912:0:5869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788581016.436535:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788581016.436579:0:5869:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788581016.436656:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788581016.436665:0:5869:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788581016.436850:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788581016.436921:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788581016.437913:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788581016.437943:0:5869:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.113@tcp 20000000:01000000:2.0:1788581016.437945:0:5869:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.113@tcp (null) (null) (null) 00000040:00080000:2.0:1788581016.437983:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788581016.437992:0:5869:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788581016.438043:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788581016.439378:0:5869:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.113@tcp (null) (null) 00000040:00080000:2.0:1788581016.439474:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788581016.439485:0:5869:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788581016.439501:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788581016.439561:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788581016.443600:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1788581016.443653:0:5869:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.113@tcp 20000000:01000000:2.0:1788581016.443656:0:5869:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.113@tcp (null) (null) (null) 00000040:00080000:2.0:1788581016.443934:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1788581016.443946:0:5869:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788581016.443995:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1788581016.444004:0:5869:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.113@tcp (null) (null) 00000040:00080000:2.0:1788581016.444039:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1788581016.444049:0:5869:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788581016.444143:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1788581016.444189:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1788581016.444217:0:5869:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788581016.444221:0:5869:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788581016.444230:0:5869:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788581016.444232:0:5869:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788581016.444281:0:5869:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788581016.444301:0:5869:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788581016.444304:0:5869:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788581016.444359:0:5869:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788581016.444363:0:5869:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788581016.446914:0:7676:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788581016.447046:0:7676:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788581016.448120:0:7676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788581016.449656:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788581016.450199:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788581016.450268:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788581016.450292:0:5869:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788581016.450296:0:5869:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788581016.452042:0:7677:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788581016.452154:0:7677:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788581016.452175:0:7677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788581016.452474:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788581016.452524:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788581016.452598:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1788581016.452616:0:5869:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788581016.452620:0:5869:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788581016.454563:0:7678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788581016.455643:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788581016.455903:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788581016.455997:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788581016.456017:0:5869:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788581016.456020:0:5869:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788581016.458647:0:7679:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788581016.459182:0:7679:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788581016.459458:0:7679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788581016.460154:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788581016.460205:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788581016.460427:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:1.0:1788581016.460450:0:5869:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788581016.460477:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fe96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.460500:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190414b3a00/0xf54e3944c2a6fde7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fde0 expref: 16 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.460509:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919044ca9000/0xf54e3944c2a6fe11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fe0a expref: 16 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.460516:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919044ca9800/0xf54e3944c2a6fe3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fe34 expref: 16 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.460858:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6fe57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fe50 expref: 16 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.460877:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6fe81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fe7a expref: 16 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.460884:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fe96 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.460938:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6fe81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6fe7a expref: 16 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.461019:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6fe81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe7a expref: 16 pid: 5871 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581016.461041:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779ce300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5869:1875463014200832:0@lo:104: 00000100:00100000:1.0:1788581016.461137:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581016.461333:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6fe57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6fe50 expref: 16 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.461343:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6fe57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe50 expref: 16 pid: 5869 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581016.461353:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779ced80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5869:1875463014200960:0@lo:104: 00010000:00010000:0.0:1788581016.461476:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919044ca9800/0xf54e3944c2a6fe3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6fe34 expref: 16 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.461486:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919044ca9800/0xf54e3944c2a6fe3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe34 expref: 16 pid: 5871 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581016.461488:0:5860:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788581016.461494:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b76a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5869:1875463014201088:0@lo:104: 00000100:00100000:3.0:1788581016.461510:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581016.461643:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014200832 00000100:00100000:3.0:1788581016.461653:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014200832 00000100:00100000:2.0:1788581016.461714:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014200960 00000100:00100000:2.0:1788581016.461718:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014200960 00000100:00100000:0.0:1788581016.461737:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788581016.461779:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919044ca9000/0xf54e3944c2a6fe11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6fe0a expref: 16 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.461788:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919044ca9000/0xf54e3944c2a6fe11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe0a expref: 16 pid: 5869 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581016.461797:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5869:1875463014201216:0@lo:104: 00000100:00100000:0.0:1788581016.461821:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788581016.461841:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190414b3a00/0xf54e3944c2a6fde7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6fde0 expref: 16 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.461849:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9190414b3a00/0xf54e3944c2a6fde7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6fde0 expref: 16 pid: 5870 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581016.461874:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014201088 00000100:00100000:2.0:1788581016.461877:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014201088 00000100:00100000:0.0:1788581016.461883:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5869:1875463014201344:0@lo:104: 00000100:00100000:2.0:1788581016.461890:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014201216 00000100:00100000:2.0:1788581016.461892:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014201216 00000100:00100000:2.0:1788581016.461907:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581016.461907:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581016.461916:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+6:5869:x1875463014200832:12345-0@lo:104: 00000100:00100000:0.0:1788581016.461920:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907b92d480 going to sleep for 11 seconds 00010000:00010000:2.0:1788581016.461932:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff9190414b2e00/0xf54e3944c2a6fe7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fe81 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.462017:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788581016.462024:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+6:5869:x1875463014200832:12345-0@lo:104: Request processed in 109us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581016.462031:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788581016.462798:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014201344 00000100:00100000:2.0:1788581016.462806:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014201344 00000100:00100000:2.0:1788581016.462833:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788581016.462842:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+6:5869:x1875463014200960:12345-0@lo:104: 00010000:00010000:2.0:1788581016.462871:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff9190414b2800/0xf54e3944c2a6fe50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fe57 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581016.462911:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779ce300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5869:1875463014200832:0@lo:104: 00010000:00010000:1.0:1788581016.462946:0:6738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581016.463067:0:6738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff9190414b2e00/0xf54e3944c2a6fe7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fe81 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.463076:0:6738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b2e00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:1.0:1788581016.463088:0:6738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff9190414b2e00/0xf54e3944c2a6fe7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6fe81 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.463097:0:6738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff9190414b2e00/0xf54e3944c2a6fe7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6fe81 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581016.463106:0:6738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff9190414b2e00/0xf54e3944c2a6fe7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6fe81 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581016.463112:0:6738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581016.463163:0:6738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff9190414b2e00/0xf54e3944c2a6fe7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe81 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.463169:0:6738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581016.463195:0:6738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff9190414b2e00/0xf54e3944c2a6fe7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe81 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.463202:0:6738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff9190414b2e00/0xf54e3944c2a6fe7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe81 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.463217:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581016.463219:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581016.463222:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581016.463236:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014201472:0@lo:103: 00010000:00010000:2.0:1788581016.463615:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1788581016.463668:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581016.463675:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff9190414b2800/0xf54e3944c2a6fe50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fe57 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.463696:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b2800 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:0.0:1788581016.463700:0:5865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff9190414b2800/0xf54e3944c2a6fe50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6fe57 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.463708:0:5865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff9190414b2800/0xf54e3944c2a6fe50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6fe57 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581016.463715:0:5865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff9190414b2800/0xf54e3944c2a6fe50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6fe57 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581016.463731:0:5865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581016.463774:0:5865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff9190414b2800/0xf54e3944c2a6fe50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe57 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.463781:0:5865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581016.463788:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff9190414b2800/0xf54e3944c2a6fe50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe57 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.463794:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff9190414b2800/0xf54e3944c2a6fe50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe57 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.463817:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581016.463819:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581016.463821:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581016.464036:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+6:5869:x1875463014200960:12345-0@lo:104: Request processed in 784us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581016.464046:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788581016.464072:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788581016.464083:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+5:5869:x1875463014201088:12345-0@lo:104: 00010000:00010000:2.0:1788581016.464093:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a6fe34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fe3b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.464149:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788581016.464155:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+5:5869:x1875463014201088:12345-0@lo:104: Request processed in 76us (2418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581016.464161:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788581016.464175:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788581016.464182:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+4:5869:x1875463014201216:12345-0@lo:104: 00010000:00010000:2.0:1788581016.464191:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a6fe0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fe11 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.464229:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788581016.464234:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+4:5869:x1875463014201216:12345-0@lo:104: Request processed in 53us (2413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581016.464240:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788581016.464281:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581016.464288:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:5869:x1875463014201344:12345-0@lo:104: 00010000:00010000:2.0:1788581016.464306:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6fde0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fde7 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.464339:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788581016.464344:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:5869:x1875463014201344:12345-0@lo:104: Request processed in 58us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581016.464351:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788581016.464446:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779ced80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5869:1875463014200960:0@lo:104: 00000100:00100000:3.0:1788581016.464473:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b76a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5869:1875463014201088:0@lo:104: 00000100:00100000:3.0:1788581016.464482:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5869:1875463014201216:0@lo:104: 00000100:00100000:3.0:1788581016.464490:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5869:1875463014201344:0@lo:104: 00010000:00010000:3.0:1788581016.464530:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fe96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581016.464693:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581016.464772:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581016.464782:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014201600:0@lo:103: 00000100:00100000:1.0:1788581016.464809:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581016.464915:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014201472 00000100:00100000:3.0:1788581016.464922:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014201472 00010000:00010000:0.0:1788581016.464928:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788581016.464935:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a6fe34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fe3b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.464942:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9a00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:0.0:1788581016.464946:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a6fe34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6fe3b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.464954:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a6fe34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6fe3b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581016.464963:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a6fe34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6fe3b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581016.464969:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581016.464995:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a6fe34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe3b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.465002:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581016.465020:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a6fe34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe3b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581016.465022:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6fe81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe7a expref: 17 pid: 5871 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.465028:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a6fe34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe3b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.465041:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1788581016.465048:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014201600 00000100:00100000:3.0:1788581016.465052:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014201600 00010000:00010000:0.0:1788581016.465064:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a6fe0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fe11 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581016.465065:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6fe57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe50 expref: 18 pid: 5869 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.465071:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040030c00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:0.0:1788581016.465074:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a6fe0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6fe11 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.465081:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a6fe0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6fe11 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581016.465084:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 10000000:00010000:0.0:1788581016.465088:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a6fe0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6fe11 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581016.465090:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:3340:x1875463014201472:12345-0@lo:103: 10000000:01000000:0.0:1788581016.465094:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788581016.465102:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581016.465106:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a6fe0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe11 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581016.465108:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6fe81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe7a expref: 18 pid: 5871 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.465113:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581016.465118:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a6fe0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe11 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581016.465120:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6fe81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe7a expref: 18 pid: 5871 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.465125:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a6fe0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe11 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.465134:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581016.465136:0:6739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6fe81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6fe7a expref: 18 pid: 5871 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.465137:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6fde0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fde7 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.465143:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8e00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:0.0:1788581016.465146:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6fde0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6fde7 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581016.465152:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581016.465161:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6fde0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6fde7 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581016.465168:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6fde0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6fde7 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581016.465173:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788581016.465184:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:3340:x1875463014201472:12345-0@lo:103: Request processed in 95us (492us total) trans 0 rc 0/0 00010000:00010000:0.0:1788581016.465186:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6fde0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fde7 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581016.465192:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788581016.465192:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581016.465201:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6fde0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fde7 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581016.465207:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788581016.465208:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6fde0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fde7 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581016.465219:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:3340:x1875463014201600:12345-0@lo:103: 00010000:00010000:0.0:1788581016.465222:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581016.465224:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581016.465226:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581016.465226:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581016.465230:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6fe57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe50 expref: 16 pid: 5869 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581016.465237:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014201728:0@lo:103: 00010000:00010000:3.0:1788581016.465239:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6fe57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe50 expref: 16 pid: 5869 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581016.465275:0:6739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6fe57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6fe50 expref: 16 pid: 5869 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581016.465287:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581016.465310:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:3340:x1875463014201600:12345-0@lo:103: Request processed in 93us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581016.465316:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581016.465341:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014201984:0@lo:103: 00000100:00100000:3.0:1788581016.465364:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581016.465387:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014201600:0@lo:103: 00000100:00100000:3.0:1788581016.465394:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014201472:0@lo:103: 00000100:00100000:3.0:1788581016.465416:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014201984 00000100:00100000:3.0:1788581016.465420:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014201984 00010000:00010000:3.0:1788581016.465433:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190414b3a00/0xf54e3944c2a6fde7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fde0 expref: 15 pid: 5870 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581016.465450:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581016.465456:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:3340:x1875463014201984:12345-0@lo:103: 00010000:00010000:3.0:1788581016.465463:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581016.465474:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190414b3a00/0xf54e3944c2a6fde7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fde0 expref: 15 pid: 5870 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581016.465482:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190414b3a00/0xf54e3944c2a6fde7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6fde0 expref: 15 pid: 5870 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581016.465492:0:6739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190414b3a00/0xf54e3944c2a6fde7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6fde0 expref: 15 pid: 5870 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581016.465501:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581016.465631:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581016.465665:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:3340:x1875463014201984:12345-0@lo:103: Request processed in 209us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581016.465672:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581016.465699:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014201984:0@lo:103: 00000100:00100000:0.0:1788581016.465944:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581016.469108:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581016.469137:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014201856:0@lo:103: 00000100:00100000:0.0:1788581016.469224:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581016.472305:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014201728 00000100:00100000:1.0:1788581016.472357:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014201728 00010000:00010000:1.0:1788581016.472414:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919044ca9800/0xf54e3944c2a6fe3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe34 expref: 14 pid: 5871 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581016.472464:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014201856 00000100:00100000:1.0:1788581016.472468:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014201856 00010000:00010000:1.0:1788581016.472483:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919044ca9000/0xf54e3944c2a6fe11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe0a expref: 15 pid: 5869 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581016.472500:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581016.472511:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:3338:x1875463014201728:12345-0@lo:103: 00010000:00010000:1.0:1788581016.472529:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581016.472535:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919044ca9800/0xf54e3944c2a6fe3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe34 expref: 15 pid: 5871 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.472549:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919044ca9800/0xf54e3944c2a6fe3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe34 expref: 15 pid: 5871 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.472571:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919044ca9800/0xf54e3944c2a6fe3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6fe34 expref: 15 pid: 5871 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581016.472589:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788581016.472591:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581016.472600:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:3338:x1875463014201856:12345-0@lo:103: 00010000:00010000:2.0:1788581016.472608:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581016.472613:0:5862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919044ca9000/0xf54e3944c2a6fe11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe0a expref: 14 pid: 5869 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.472621:0:5862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919044ca9000/0xf54e3944c2a6fe11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe0a expref: 14 pid: 5869 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.472632:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919044ca9000/0xf54e3944c2a6fe11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6fe0a expref: 14 pid: 5869 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.472644:0:5862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fe96 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.472654:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fe96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581016.472664:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:3338:x1875463014201728:12345-0@lo:103: Request processed in 155us (6719us total) trans 0 rc 0/0 00010000:00010000:2.0:1788581016.472672:0:5862:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fe96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581016.472672:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1788581016.473231:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fe96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.473874:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fe96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.473882:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fe96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.473888:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8400 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:2.0:1788581016.473894:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fe96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.473896:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581016.473904:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fe96 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.473940:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fe96 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.473957:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581016.474017:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:3338:x1875463014201856:12345-0@lo:103: Request processed in 1418us (4791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581016.474026:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788581016.474192:0:5869:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fe96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.474199:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fe96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.474215:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fe96 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788581016.474261:0:5869:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788581016.482421:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014201856:0@lo:103: 00000100:00100000:0.0:1788581016.482445:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014201728:0@lo:103: 00010000:00010000:0.0:1788581016.559460:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581016.576917:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:7675:x1875463014200704:12345-0@lo:253: Request processed in 147286us (147951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581016.576934:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788581016.577061:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014200704:0@lo:253: 10000000:01000000:2.0:1788581016.577084:0:7675:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788581016.577089:0:7675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788581016.577091:0:7675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788581016.577093:0:7675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581016.577095:0:7675:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788581016.577096:0:7675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581016.577098:0:7675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581016.577100:0:7675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788581016.577101:0:7675:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788581016.577104:0:7675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581016.577124:0:7675:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788581016.577149:0:7675:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91907f8f1000 from lustre-OST0001 10000000:01000000:2.0:1788581016.577179:0:7675:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788581016.577182:0:7675:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788581016.577192:0:7675:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff919047dccd28 local copy 10000000:01000000:2.0:1788581016.577205:0:7675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788581016.577277:0:7675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a6fe9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.577290:0:7675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a6fe9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.577301:0:7675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a6fe9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581016.577325:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014202112:0@lo:101: 00000100:00100000:2.0:1788581016.577381:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581016.577446:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048de0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788581016.577593:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014202112 00000100:00100000:1.0:1788581016.577600:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014202112 00000100:00100000:1.0:1788581016.577645:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788581016.577656:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+11:7675:x1875463014202112:12345-0@lo:101: 00010000:00010000:1.0:1788581016.577673:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581016.577697:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fea4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fe9d expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.577727:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fe9d expref: 12 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.577740:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fe9d expref: 12 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.577750:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8400, rc 0) 00000100:00100000:1.0:1788581016.577787:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:7675:x1875463014202112:12345-0@lo:101: Request processed in 133us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581016.577794:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788581016.577941:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014202112:0@lo:101: 00010000:00010000:2.0:1788581016.577955:0:7675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a6fe9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf54e3944c2a6fea4 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.577966:0:7675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a6fe9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf54e3944c2a6fea4 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581016.578101:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014202240:0@lo:501: 00000100:00100000:2.0:1788581016.578124:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581016.578146:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048de0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788581016.578166:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014202240 00000100:00100000:1.0:1788581016.578171:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014202240 00000100:00100000:1.0:1788581016.578198:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788581016.578217:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:7675:x1875463014202240:12345-0@lo:501: 00000100:00100000:1.0:1788581016.578803:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:7675:x1875463014202240:12345-0@lo:501: Request processed in 585us (674us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788581016.578813:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788581016.578834:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014202240:0@lo:501: 10000000:01000000:2.0:1788581016.578849:0:7675:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788581016.578892:0:7675:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788581016.578897:0:7675:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a6fe9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf54e3944c2a6fea4 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.578904:0:7675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a6fe9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf54e3944c2a6fea4 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.578909:0:7675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a6fe9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf54e3944c2a6fea4 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.578928:0:7675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581016.578954:0:6738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1788581016.578957:0:7675:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91907f8f1000 10000000:01000000:2.0:1788581016.578961:0:7675:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788581016.578961:0:6738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a6fe9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf54e3944c2a6fea4 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581016.578967:0:7675:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 00010000:00010000:1.0:1788581016.578968:0:6738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce400 already unused, calling callback (ffffffffc1cf0c20) 10000000:01000000:2.0:1788581016.578969:0:7675:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:00010000:1.0:1788581016.578972:0:6738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a6fe9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf54e3944c2a6fea4 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581016.578975:0:7675:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788581016.578977:0:7675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788581016.578982:0:6738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a6fe9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf54e3944c2a6fea4 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581016.578990:0:6738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a6fe9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf54e3944c2a6fea4 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581016.578997:0:6738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788581016.579000:0:7675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821cec00/0xf54e3944c2a6feab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.579007:0:7675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff9190821cec00/0xf54e3944c2a6feab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.579015:0:7675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff9190821cec00/0xf54e3944c2a6feab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.579025:0:6738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a6fe9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf54e3944c2a6fea4 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581016.579029:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014202368:0@lo:101: 00010000:00010000:1.0:1788581016.579033:0:6738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788581016.579056:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581016.579091:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048de0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581016.579103:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014202496:0@lo:103: 00000100:00100000:3.0:1788581016.579139:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581016.579151:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014202368 00000100:00100000:0.0:1788581016.579157:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014202368 00010000:00010000:1.0:1788581016.579186:0:6738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a6fe9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf54e3944c2a6fea4 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.579195:0:6738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a6fe9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf54e3944c2a6fea4 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.579212:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581016.579220:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581016.579222:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581016.579465:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788581016.579477:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:7675:x1875463014202368:12345-0@lo:101: 00010000:00010000:0.0:1788581016.579489:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581016.579502:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919040030c00/0xf54e3944c2a6feb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6feab expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.579623:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919040030c00/0xf54e3944c2a6feb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6feab expref: 13 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.579636:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919040030c00/0xf54e3944c2a6feb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6feab expref: 13 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.579646:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919040030c00, rc 0) 00000100:00100000:3.0:1788581016.579663:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014202496 00000100:00100000:3.0:1788581016.579667:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014202496 00000100:00100000:0.0:1788581016.579761:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:7675:x1875463014202368:12345-0@lo:101: Request processed in 287us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581016.579769:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788581016.579810:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581016.579818:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:3341:x1875463014202496:12345-0@lo:103: 00010000:00010000:3.0:1788581016.579829:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581016.579843:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919044ca8400/0xf54e3944c2a6fea4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf54e3944c2a6fe9d expref: 13 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581016.579854:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581016.579898:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014202368:0@lo:101: 00010000:00010000:2.0:1788581016.579918:0:7675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff9190821cec00/0xf54e3944c2a6feab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6feb2 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.579927:0:7675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff9190821cec00/0xf54e3944c2a6feab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6feb2 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581016.579929:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:3341:x1875463014202496:12345-0@lo:103: Request processed in 112us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581016.579936:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581016.579996:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014202496:0@lo:103: 00000100:00100000:2.0:1788581016.580014:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014202624:0@lo:501: 00000100:00100000:2.0:1788581016.580041:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581016.580067:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048de0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581016.580122:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014202624 00000100:00100000:1.0:1788581016.580125:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014202624 00000100:00100000:1.0:1788581016.580148:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788581016.580156:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:7675:x1875463014202624:12345-0@lo:501: 00000100:00100000:0.0:1788581016.580647:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:7675:x1875463014202624:12345-0@lo:501: Request processed in 491us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581016.580653:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788581016.580807:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014202624:0@lo:501: 00000100:00100000:2.0:1788581016.580833:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014202752:0@lo:503: 00000100:00100000:2.0:1788581016.580886:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581016.580911:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048de0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581016.580920:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014202752 00000100:00100000:1.0:1788581016.580926:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014202752 00000100:00100000:1.0:1788581016.580956:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788581016.580965:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:7675:x1875463014202752:12345-0@lo:503: 00000100:00100000:1.0:1788581016.581120:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:7675:x1875463014202752:12345-0@lo:503: Request processed in 156us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581016.581127:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788581016.581146:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014202752:0@lo:503: 00000040:00080000:2.0:1788581016.581609:0:7675:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788581016.581673:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014202880:0@lo:502: 00000100:00100000:2.0:1788581016.581765:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581016.581842:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048de0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581016.581895:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014202880 00000100:00100000:0.0:1788581016.581901:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014202880 00000100:00100000:0.0:1788581016.581960:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788581016.581966:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:7675:x1875463014202880:12345-0@lo:502: 00000100:00100000:0.0:1788581016.582105:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:7675:x1875463014202880:12345-0@lo:502: Request processed in 139us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581016.582121:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788581016.582134:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014202880:0@lo:502: 00000040:00080000:1.0:1788581016.582632:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788581016.582675:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788581016.582923:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788581016.582969:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788581016.582992:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788581016.583008:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788581016.583035:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014203008:0@lo:502: 00000100:00100000:0.0:1788581016.583084:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581016.583134:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014203008 00000100:00100000:1.0:1788581016.583139:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014203008 00000100:00100000:0.0:1788581016.583139:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907b9099c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581016.583186:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788581016.583193:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:7675:x1875463014203008:12345-0@lo:502: 00000100:00100000:1.0:1788581016.583900:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:7675:x1875463014203008:12345-0@lo:502: Request processed in 703us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581016.583910:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788581016.583929:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014203008:0@lo:502: 00000040:00080000:0.0:1788581016.584032:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788581016.584046:0:7675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788581016.584850:0:7685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788581016.584875:0:7685:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788581016.584882:0:7685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581016.584884:0:7685:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788581016.584888:0:7685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788581016.584906:0:7685:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff919076210000) 00000020:00000080:0.0:1788581016.584930:0:7685:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788581016.584933:0:7685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788581016.584998:0:7685:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91907f8f1000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788581016.585004:0:7685:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788581016.585010:0:7685:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf54e3944c2a6fec0 00010000:00010000:0.0:1788581016.591154:0:7685:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788581016.593222:0:7685:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788581016.604534:0:7685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788581016.605788:0:7685:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788581016.626992:0:7685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788581016.644185:0:7685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788581016.660851:0:7685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788581016.660885:0:7685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581016.660892:0:7685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581016.660895:0:7685:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788581016.660899:0:7685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581016.660913:0:7685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581016.660915:0:7685:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788581016.660919:0:7685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788581016.660921:0:7685:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788581016.660984:0:7685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581016.660988:0:7685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581016.660989:0:7685:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788581016.660992:0:7685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788581016.663965:0:7675:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788581016.664009:0:7675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788581016.664041:0:7675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821cec00/0xf54e3944c2a6feab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6feb2 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.664054:0:7675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff9190821cec00/0xf54e3944c2a6feab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6feb2 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581016.664081:0:7675:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91907f8f1000 from 1 10000000:01000000:2.0:1788581016.664084:0:7675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788581016.664129:0:7675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a6fec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.664137:0:7675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a6fec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.664148:0:7675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a6fec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581016.664172:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014203136:0@lo:101: 00000100:00100000:2.0:1788581016.664691:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581016.664752:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048de0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581016.664932:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014203136 00000100:00100000:0.0:1788581016.664942:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014203136 00000100:00100000:0.0:1788581016.665002:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788581016.665012:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:7675:x1875463014203136:12345-0@lo:101: 00010000:00010000:0.0:1788581016.665034:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581016.665047:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919040030200/0xf54e3944c2a6fece lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fec7 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.665073:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919040030200/0xf54e3944c2a6fece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fec7 expref: 13 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.665083:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919040030200/0xf54e3944c2a6fece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fec7 expref: 13 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.665107:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919040030200, rc 0) 00000100:00100000:0.0:1788581016.665167:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:7675:x1875463014203136:12345-0@lo:101: Request processed in 156us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581016.665173:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788581016.666515:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014203136:0@lo:101: 00010000:00010000:2.0:1788581016.666544:0:7675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a6fec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fece expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.666567:0:7675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a6fec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fece expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581016.666712:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014203264:0@lo:501: 00000100:00100000:2.0:1788581016.666767:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581016.666801:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048de0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581016.669550:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014203264 00000100:00100000:2.0:1788581016.669663:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014203264 00000100:00100000:3.0:1788581016.671893:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788581016.672533:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:7675:x1875463014203264:12345-0@lo:501: 00000100:00100000:3.0:1788581016.672888:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:7675:x1875463014203264:12345-0@lo:501: Request processed in 368us (6120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581016.672897:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788581016.676804:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014203264:0@lo:501: 00000100:00100000:2.0:1788581016.676895:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014203392:0@lo:503: 00000100:00100000:2.0:1788581016.676986:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581016.677038:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048de0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581016.677808:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014203392 00000100:00100000:3.0:1788581016.677819:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014203392 00000100:00100000:3.0:1788581016.677879:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788581016.677891:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:7675:x1875463014203392:12345-0@lo:503: 00000100:00100000:3.0:1788581016.678347:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:7675:x1875463014203392:12345-0@lo:503: Request processed in 457us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581016.678355:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788581016.679639:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014203392:0@lo:503: 00000040:00080000:2.0:1788581016.679991:0:7675:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788581016.680074:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014203520:0@lo:502: 00000100:00100000:2.0:1788581016.680156:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581016.680200:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048de0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581016.680741:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014203520 00000100:00100000:0.0:1788581016.680749:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014203520 00000100:00100000:0.0:1788581016.680787:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788581016.680795:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:7675:x1875463014203520:12345-0@lo:502: 00000100:00100000:0.0:1788581016.681041:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:7675:x1875463014203520:12345-0@lo:502: Request processed in 245us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581016.681048:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788581016.683157:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014203520:0@lo:502: 00000040:00080000:2.0:1788581016.687229:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788581016.687345:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788581016.687399:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014203648:0@lo:502: 00000100:00100000:2.0:1788581016.687488:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581016.687533:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048de0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581016.708754:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014203648 00000100:00100000:0.0:1788581016.708769:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014203648 00000100:00100000:0.0:1788581016.708840:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788581016.708850:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:7675:x1875463014203648:12345-0@lo:502: 00000100:00100000:0.0:1788581016.710373:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:7675:x1875463014203648:12345-0@lo:502: Request processed in 1518us (22878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581016.710386:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788581016.720648:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014203648:0@lo:502: 00000040:00080000:3.0:1788581016.720976:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788581016.720994:0:7675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788581016.721760:0:7689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581016.721771:0:7689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581016.721773:0:7689:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788581016.721780:0:7689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91907f8f1000 00000020:00000080:0.0:1788581016.721782:0:7689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788581016.721798:0:7689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581016.721801:0:7689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581016.721803:0:7689:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788581016.721805:0:7689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788581016.721934:0:7675:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788581016.721955:0:7675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788581016.721976:0:7675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a6fec7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fece expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581016.722000:0:7675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a6fec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fece expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581016.722040:0:7675:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788581016.722044:0:7675:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91907f8f1000 10000000:01000000:3.0:1788581016.722047:0:7675:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91907f8f1000 10000000:01000000:3.0:1788581016.722052:0:7675:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788581016.722058:0:7675:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91907f8f1000 from 1 10000000:01000000:3.0:1788581016.722060:0:7675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788581016.722095:0:7675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581016.722104:0:7675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581016.722114:0:7675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581016.722136:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014203776:0@lo:101: 00000100:00100000:3.0:1788581016.722203:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581016.722290:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907ba28540 going to sleep for 11 seconds 00000100:00100000:2.0:1788581016.722606:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014203776 00000100:00100000:2.0:1788581016.722614:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014203776 00000100:00100000:2.0:1788581016.722662:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788581016.722671:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:7675:x1875463014203776:12345-0@lo:101: 00010000:00010000:2.0:1788581016.722684:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581016.722697:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821ce000/0xf54e3944c2a6fedc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fed5 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.722720:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821ce000/0xf54e3944c2a6fedc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fed5 expref: 14 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.722744:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821ce000/0xf54e3944c2a6fedc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fed5 expref: 14 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.722753:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce000, rc 0) 00000100:00100000:2.0:1788581016.722802:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:7675:x1875463014203776:12345-0@lo:101: Request processed in 132us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581016.722808:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788581016.722897:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014203776:0@lo:101: 00010000:00010000:0.0:1788581016.722913:0:7675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fed5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fedc expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.722922:0:7675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fed5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fedc expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581016.723004:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014203904:0@lo:501: 00000100:00100000:0.0:1788581016.723031:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581016.723071:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076c4d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788581016.723484:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014203904 00000100:00100000:3.0:1788581016.723490:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014203904 00000100:00100000:3.0:1788581016.723525:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788581016.723532:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:7675:x1875463014203904:12345-0@lo:501: 00000100:00100000:3.0:1788581016.723751:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:7675:x1875463014203904:12345-0@lo:501: Request processed in 218us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581016.723758:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788581016.723976:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014203904:0@lo:501: 00000100:00100000:1.0:1788581016.724010:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014204032:0@lo:503: 00000100:00100000:1.0:1788581016.724053:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581016.724088:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907b92d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581016.724211:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014204032 00000100:00100000:2.0:1788581016.724217:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014204032 00000100:00100000:2.0:1788581016.724285:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788581016.724293:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:7675:x1875463014204032:12345-0@lo:503: 00000100:00100000:2.0:1788581016.724450:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:7675:x1875463014204032:12345-0@lo:503: Request processed in 157us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581016.724457:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788581016.724704:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014204032:0@lo:503: 00000040:00080000:1.0:1788581016.724999:0:7675:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581016.725058:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014204160:0@lo:502: 00000100:00100000:1.0:1788581016.725098:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581016.725129:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907b92d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581016.725618:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014204160 00000100:00100000:3.0:1788581016.725626:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014204160 00000100:00100000:3.0:1788581016.725670:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788581016.725678:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:7675:x1875463014204160:12345-0@lo:502: 00000100:00100000:3.0:1788581016.725912:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:7675:x1875463014204160:12345-0@lo:502: Request processed in 222us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581016.725921:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788581016.727870:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014204160:0@lo:502: 00000040:00080000:1.0:1788581016.728257:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788581016.728324:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788581016.728363:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788581016.728427:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788581016.728463:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788581016.728511:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788581016.728545:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788581016.728578:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788581016.728623:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788581016.728657:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788581016.728686:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788581016.728725:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788581016.728755:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788581016.728781:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788581016.728818:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788581016.728847:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788581016.728892:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788581016.728944:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788581016.728977:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788581016.729017:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788581016.729057:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788581016.729086:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788581016.729123:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788581016.729180:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788581016.729214:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788581016.729263:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788581016.729311:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788581016.729345:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788581016.729373:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788581016.729411:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788581016.729440:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788581016.729468:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788581016.729494:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788581016.729544:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788581016.729577:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788581016.729628:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788581016.729659:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788581016.729699:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014204288:0@lo:502: 00000100:00100000:1.0:1788581016.729773:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581016.729821:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907b92d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581016.729999:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014204288 00000100:00100000:0.0:1788581016.730008:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014204288 00000100:00100000:0.0:1788581016.730069:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788581016.730080:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:7675:x1875463014204288:12345-0@lo:502: 00000100:00100000:0.0:1788581016.735139:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:7675:x1875463014204288:12345-0@lo:502: Request processed in 5051us (5357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581016.735153:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788581016.735237:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014204288:0@lo:502: 00000040:00080000:1.0:1788581016.735877:0:7675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788581016.735894:0:7675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788581016.745404:0:7690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788581016.745423:0:7690:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff919046a699b8) 00000020:00000080:3.0:1788581016.745446:0:7690:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788581016.745538:0:7690:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91907f8f1000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788581016.745542:0:7690:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91907f8f1000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788581016.745545:0:7690:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91907f8f1000 3 00010000:00080000:3.0:1788581016.745588:0:7690:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919077984800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.113@tcp at head 00010000:00010000:3.0:1788581016.749486:0:7690:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788581016.750326:0:7690:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788581016.750364:0:7690:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788581016.750378:0:7690:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf54e3944c2a6feea 00000100:00080000:3.0:1788581016.750391:0:7690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788581016.750399:0:7690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff919077984800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:3.0:1788581016.750434:0:7690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91906c60d500 x1875463014204416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581016.750455:0:7690:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788581016.750805:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3337:1875463014204416:0@lo:38: 00000100:00100000:1.0:1788581016.750893:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581016.750968:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014204416 00000100:00100000:1.0:1788581016.750975:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014204416 00000100:00100000:1.0:1788581016.751099:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581016.751107:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3337:x1875463014204416:12345-0@lo:38: 00010000:00080000:1.0:1788581016.751130:0:5876:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:1.0:1788581016.751168:0:5876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf54e3944c2a6fef1 00000004:00100000:1.0:1788581016.751189:0:5876:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788581016.751221:0:5876:0:(import.c:65:import_set_state_nolock()) ffff919075ecc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581016.751302:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3337:x1875463014204416:12345-0@lo:38: Request processed in 193us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581016.751309:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788581016.751345:0:3337:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91906c60d500 x1875463014204416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581016.751355:0:3337:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788581016.751363:0:3337:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788581016.751370:0:3337:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788581016.751373:0:3337:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788581016.751375:0:3337:0:(import.c:65:import_set_state_nolock()) ffff919077984800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788581016.751381:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3337:1875463014204416:0@lo:38: 00000100:00100000:2.0:1788581016.751564:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014204672:0@lo:400: 00000100:00100000:2.0:1788581016.751610:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581016.751632:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581016.751638:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3339:1875463014204544:0@lo:400: 00000100:00100000:2.0:1788581016.751664:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581016.751689:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014204800:0@lo:400: 00000100:00100000:2.0:1788581016.751719:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581016.751752:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014204672 00000100:00100000:2.0:1788581016.751757:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014204672 00000100:00100000:2.0:1788581016.751791:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014204544 00000100:00100000:2.0:1788581016.751794:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014204544 00000100:00100000:2.0:1788581016.751808:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788581016.751816:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014204672:12345-0@lo:400: 00000100:00100000:2.0:1788581016.751879:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014204672:12345-0@lo:400: Request processed in 63us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581016.751885:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788581016.751899:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788581016.751906:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3339:x1875463014204544:12345-0@lo:400: 00000100:00100000:2.0:1788581016.751935:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3339:x1875463014204544:12345-0@lo:400: Request processed in 30us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581016.751941:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788581016.751960:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014204800 00000100:00100000:2.0:1788581016.751964:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014204800 00000100:00100000:2.0:1788581016.751990:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581016.752674:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014204800:12345-0@lo:400: 00000100:00080000:0.0:1788581016.752710:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788581016.752717:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581016.752731:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014204800:12345-0@lo:400: Request processed in 734us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581016.752738:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788581016.752883:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919048580e00 x1875463014204800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581016.752905:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014204800:0@lo:400: 00010000:00080000:2.0:1788581016.752934:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919048582d80 x1875463014204544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581016.752944:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3339:1875463014204544:0@lo:400: 00010000:00080000:2.0:1788581016.753128:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919048581180 x1875463014204672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581016.753137:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014204672:0@lo:400: 00000100:00100000:3.0:1788581016.753387:0:7691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60ca80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7691:1875463014204928:0@lo:901: 00000100:00100000:3.0:1788581016.753438:0:7691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581016.753466:0:7691:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907ba28300 going to sleep for 11 seconds 00000100:00100000:0.0:1788581016.753495:0:5887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014204928 00000100:00100000:0.0:1788581016.753502:0:5887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014204928 00000100:00100000:0.0:1788581016.753563:0:5887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788581016.753572:0:5887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7691:x1875463014204928:12345-0@lo:901: 00000040:00080000:3.0:1788581016.753584:0:7690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1788581016.753954:0:5887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7691:x1875463014204928:12345-0@lo:901: Request processed in 384us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581016.753965:0:5887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788581016.753991:0:7691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91906c60ca80 x1875463014204928/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788581032 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581016.754154:0:7691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60ca80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7691:1875463014204928:0@lo:901: 00000100:00080000:2.0:1788581016.754272:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:2.0:1788581016.754291:0:7675:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788581016.754317:0:7675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788581016.754334:0:7675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fed5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fedc expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.754345:0:7675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fedc expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788581016.754395:0:7675:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788581016.754397:0:7675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788581016.754398:0:7675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581016.754400:0:7675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581016.754401:0:7675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581016.754403:0:7675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581016.754404:0:7675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788581016.754406:0:7675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788581016.754407:0:7675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788581016.754409:0:7675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581016.754410:0:7675:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788581016.754413:0:7675:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788581016.754416:0:7675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788581016.754417:0:7675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788581016.754418:0:7675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581016.754419:0:7675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581016.754420:0:7675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581016.754422:0:7675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581016.754423:0:7675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788581016.754424:0:7675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788581016.754425:0:7675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788581016.754426:0:7675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581016.754427:0:7675:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788581016.754441:0:7675:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788581016.754451:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014205056:0@lo:253: 00000100:00100000:2.0:1788581016.754484:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581016.754515:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048de0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788581016.754522:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014205056 00000100:00100000:0.0:1788581016.754528:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014205056 00000100:00100000:0.0:1788581016.754569:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788581016.754578:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:7675:x1875463014205056:12345-0@lo:253: 20000000:01000000:0.0:1788581016.754599:0:5870:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788581016.754613:0:5870:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788581016.823581:0:5870:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788581016.823607:0:5870:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788581016.823892:0:5892:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788581016.823898:0:5892:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788581016.823921:0:5892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919040030e00/0xf54e3944c2a6fef8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.823940:0:5892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fe42 expref: 14 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.823949:0:5892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919040030e00/0xf54e3944c2a6fef8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.823986:0:5892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6fe42 expref: 14 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.824000:0:5892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe42 expref: 14 pid: 5871 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581016.824015:0:5892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5892:1875463014205184:0@lo:104: 00000100:00100000:0.0:1788581016.824078:0:5892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581016.824291:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014205184 00000100:00100000:0.0:1788581016.824301:0:5892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190768a8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581016.824302:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014205184 00000100:00100000:3.0:1788581016.824364:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788581016.824376:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:5892:x1875463014205184:12345-0@lo:104: 00010000:00010000:3.0:1788581016.824391:0:5860:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6fe42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fe49 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581016.825138:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788581016.825147:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:5892:x1875463014205184:12345-0@lo:104: Request processed in 773us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581016.825154:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788581016.825259:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581016.825274:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6fe42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fe49 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.825283:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf400 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:1.0:1788581016.825287:0:5865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6fe42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6fe49 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.825296:0:5865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6fe42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6fe49 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581016.825304:0:5865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6fe42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6fe49 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581016.825322:0:5865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581016.825360:0:5865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6fe42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe49 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.825367:0:5865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581016.825388:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6fe42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe49 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.825396:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6fe42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe49 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581016.825410:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581016.825412:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581016.825414:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581016.825426:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014205312:0@lo:103: 00000100:00100000:1.0:1788581016.825462:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581016.825783:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014205312 00000100:00100000:0.0:1788581016.825790:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014205312 00010000:00010000:0.0:1788581016.825815:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe42 expref: 15 pid: 5871 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581016.825849:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788581016.825867:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:3341:x1875463014205312:12345-0@lo:103: 00010000:00010000:0.0:1788581016.825879:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581016.825885:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe42 expref: 15 pid: 5871 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.825897:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6fe42 expref: 15 pid: 5871 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.825916:0:6739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919040030e00/0xf54e3944c2a6fef8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.825925:0:6739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919040030e00/0xf54e3944c2a6fef8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788581016.825939:0:6739:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002041438s 00010000:00010000:0.0:1788581016.825944:0:6739:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919040030e00/0xf54e3944c2a6fef8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.825951:0:6739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919040030e00/0xf54e3944c2a6fef8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.825958:0:6739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919040030e00/0xf54e3944c2a6fef8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.825965:0:6739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919040030e00/0xf54e3944c2a6fef8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.825978:0:6739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040030e00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581016.825982:0:6739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919040030e00/0xf54e3944c2a6fef8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.825990:0:6739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919040030e00/0xf54e3944c2a6fef8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.825998:0:6739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919040030e00/0xf54e3944c2a6fef8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581016.826007:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581016.826055:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:3341:x1875463014205312:12345-0@lo:103: Request processed in 199us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581016.826062:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788581016.826489:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014205312:0@lo:103: 00010000:00010000:2.0:1788581016.826717:0:5892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919040031e00/0xf54e3944c2a6fe49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6fe42 expref: 14 pid: 5871 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581016.826742:0:5892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5892:1875463014205184:0@lo:104: 00010000:00010000:2.0:1788581016.826758:0:5892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919040030e00/0xf54e3944c2a6fef8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.826768:0:5892:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919040030e00/0xf54e3944c2a6fef8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.826774:0:5892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919040030e00/0xf54e3944c2a6fef8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581016.826782:0:5892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919040030e00/0xf54e3944c2a6fef8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581016.838343:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:7675:x1875463014205056:12345-0@lo:253: Request processed in 83755us (83847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581016.838359:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788581016.838539:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:7675:1875463014205056:0@lo:253: 10000000:01000000:2.0:1788581016.838555:0:7675:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788581016.838559:0:7675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788581016.838561:0:7675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788581016.838562:0:7675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581016.838564:0:7675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581016.838565:0:7675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581016.838566:0:7675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581016.838568:0:7675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788581016.838569:0:7675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788581016.838571:0:7675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788581016.838572:0:7675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581016.838574:0:7675:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788581016.838588:0:7675:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788581016.845750:0:7675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788581016.845936:0:7675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788581016.846141:0:7675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788581016.846359:0:7675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788581016.846573:0:7675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788581016.848828:0:7675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788581016.852681:0:7675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788581017.218379:0:7675:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788581017.218388:0:7675:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788581017.218539:0:7675:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788581017.218609:0:7675:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788581017.218622:0:7675:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788581017.218647:0:7675:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788581017.589601:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581018.607945:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581018.739226:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581018.739282:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014205440:0@lo:13: 00000100:00100000:0.0:1788581018.739370:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581018.739839:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014205440 00000100:00100000:1.0:1788581018.739856:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014205440 00000100:00100000:1.0:1788581018.739921:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788581018.739931:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014205440:12345-0@lo:13: 00002000:00000024:1.0:1788581018.739965:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581018.740024:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014205440:12345-0@lo:13: Request processed in 95us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581018.740040:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788581018.740194:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788581018.741239:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919048581180 x1875463014205440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581018.741277:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014205440:0@lo:13: 00010000:00010000:1.0:1788581019.634769:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581020.666015:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581021.679489:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581021.807529:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014205696:0@lo:400: 00000100:00100000:2.0:1788581021.807604:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581021.807662:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581021.807679:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014205824:0@lo:400: 00000100:00100000:2.0:1788581021.807706:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581021.807742:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014205696 00000100:00100000:2.0:1788581021.807749:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014205696 00000100:00100000:2.0:1788581021.807808:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014205824 00000100:00100000:2.0:1788581021.807812:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014205824 00000100:00100000:2.0:1788581021.807839:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788581021.807847:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014205696:12345-0@lo:400: 00000100:00100000:2.0:1788581021.807898:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014205696:12345-0@lo:400: Request processed in 52us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581021.807906:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788581021.807921:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788581021.807927:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014205824:12345-0@lo:400: 00000100:00100000:2.0:1788581021.807956:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014205824:12345-0@lo:400: Request processed in 29us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581021.807962:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788581021.807982:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788581021.808008:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919048581180 x1875463014205824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581021.808022:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014205824:0@lo:400: 00010000:00080000:2.0:1788581021.808034:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919048580e00 x1875463014205696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581021.808042:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014205696:0@lo:400: 00000100:00100000:1.0:1788581021.808208:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014205952:0@lo:400: 00000100:00100000:1.0:1788581021.808278:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581021.808298:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788581021.808304:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014205568:0@lo:400: 00000100:00100000:1.0:1788581021.808332:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581021.808351:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3338:1875463014206080:0@lo:400: 00000100:00100000:1.0:1788581021.808372:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581021.808455:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014205568 00000100:00100000:0.0:1788581021.808461:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014205568 00000100:00100000:0.0:1788581021.808502:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788581021.808510:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:3338:x1875463014205568:12345-0@lo:400: 00000100:00100000:0.0:1788581021.808561:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:3338:x1875463014205568:12345-0@lo:400: Request processed in 52us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581021.808567:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788581021.808600:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014205568:0@lo:400: 00000100:00100000:2.0:1788581021.808818:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014205952 00000100:00100000:2.0:1788581021.808823:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014205952 00000100:00100000:2.0:1788581021.808871:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581021.808878:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014205952:12345-0@lo:400: 00000100:00100000:2.0:1788581021.808927:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014205952:12345-0@lo:400: Request processed in 49us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581021.808935:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788581021.808963:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919048581880 x1875463014205952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581021.808973:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014205952:0@lo:400: 00000100:00100000:2.0:1788581021.808993:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014206080 00000100:00100000:2.0:1788581021.808996:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014206080 00000100:00100000:2.0:1788581021.809020:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788581021.809026:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3338:x1875463014206080:12345-0@lo:400: 00000100:00100000:2.0:1788581021.809062:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3338:x1875463014206080:12345-0@lo:400: Request processed in 35us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581021.809068:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788581021.809098:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919048581f80 x1875463014206080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581021.809108:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3338:1875463014206080:0@lo:400: 00000100:00080000:0.0:1788581021.809352:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788581021.809357:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788581022.703741:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581023.732732:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581023.861268:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581023.861298:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014206208:0@lo:13: 00000100:00100000:1.0:1788581023.861365:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581023.861439:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014206208 00000100:00100000:1.0:1788581023.861448:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014206208 00000100:00100000:1.0:1788581023.861929:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581023.861940:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014206208:12345-0@lo:13: 00002000:00000024:1.0:1788581023.861979:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581023.862035:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014206208:12345-0@lo:13: Request processed in 98us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581023.862042:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788581023.862571:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788581023.862607:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190779cd180 x1875463014206208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581023.862626:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014206208:0@lo:13: 00000001:02000400:3.0:1788581024.455380:0:8035:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788581024.752957:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581025.776781:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788581026.415342:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788581026.415351:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91906c6c6000 from 30 10000000:01000000:0.0:1788581026.415359:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788581026.415407:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a6feff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581026.415420:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a6feff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581026.415433:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a6feff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581026.415459:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014206336:0@lo:101: 00000100:00100000:0.0:1788581026.415546:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.415633:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581026.416747:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014206336 00000100:00100000:2.0:1788581026.416760:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014206336 00000100:00100000:2.0:1788581026.416811:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788581026.416821:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:5874:x1875463014206336:12345-0@lo:101: 00010000:00010000:2.0:1788581026.416839:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581026.416975:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821ce400/0xf54e3944c2a6ff06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6feff expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.417005:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821ce400/0xf54e3944c2a6ff06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6feff expref: 14 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.417025:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821ce400/0xf54e3944c2a6ff06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6feff expref: 14 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.417034:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce400, rc 0) 00000100:00100000:2.0:1788581026.417112:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:5874:x1875463014206336:12345-0@lo:101: Request processed in 282us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581026.417120:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788581026.417431:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014206336:0@lo:101: 00010000:00010000:0.0:1788581026.417451:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a6feff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff06 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581026.417461:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a6feff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6ff06 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581026.417535:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014206464:0@lo:501: 00000100:00100000:0.0:1788581026.417570:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.417928:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581026.418018:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014206464 00000100:00100000:2.0:1788581026.418024:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014206464 00000100:00100000:2.0:1788581026.418058:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788581026.418068:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:5874:x1875463014206464:12345-0@lo:501: 00000100:00100000:2.0:1788581026.419586:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:5874:x1875463014206464:12345-0@lo:501: Request processed in 1513us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581026.419597:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788581026.420374:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014206464:0@lo:501: 00000100:00100000:1.0:1788581026.420433:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014206592:0@lo:503: 00000100:00100000:1.0:1788581026.420489:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581026.420525:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581026.420704:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014206592 00000100:00100000:0.0:1788581026.420783:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014206592 00000100:00100000:0.0:1788581026.420835:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788581026.420915:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:5874:x1875463014206592:12345-0@lo:503: 00000100:00100000:0.0:1788581026.422098:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:5874:x1875463014206592:12345-0@lo:503: Request processed in 1249us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581026.422411:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014206592:0@lo:503: 00000100:00100000:0.0:1788581026.422987:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788581026.424026:0:8138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8138:1875463014206720:0@lo:502: 00000100:00100000:0.0:1788581026.424099:0:8138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.425147:0:8138:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581026.426978:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014206720 00000100:00100000:2.0:1788581026.426993:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014206720 00000100:00100000:2.0:1788581026.427053:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788581026.427064:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:8138:x1875463014206720:12345-0@lo:502: 00000100:00100000:2.0:1788581026.428088:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:8138:x1875463014206720:12345-0@lo:502: Request processed in 1021us (3984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581026.428100:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788581026.432422:0:8138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8138:1875463014206720:0@lo:502: 00000100:00100000:0.0:1788581026.432989:0:8138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8138:1875463014206848:0@lo:502: 00000100:00100000:0.0:1788581026.433065:0:8138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581026.434739:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014206848 00000100:00100000:1.0:1788581026.434752:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014206848 00000100:00100000:1.0:1788581026.434821:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788581026.434833:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:8138:x1875463014206848:12345-0@lo:502: 00000100:00100000:1.0:1788581026.435832:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:8138:x1875463014206848:12345-0@lo:502: Request processed in 996us (2761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581026.435855:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788581026.436180:0:8138:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581026.436210:0:8138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8138:1875463014206848:0@lo:502: 00000040:00080000:0.0:1788581026.437458:0:8138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788581026.437988:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788581026.438014:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788581026.438027:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a6feff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff06 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.438041:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a6feff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff06 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581026.438067:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788581026.438069:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788581026.438072:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788581026.438190:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6ff0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.438200:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6ff0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.438211:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6ff0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581026.438233:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014206976:0@lo:101: 00000100:00100000:2.0:1788581026.439007:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581026.439125:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190721873c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581026.439229:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014206976 00000100:00100000:1.0:1788581026.439480:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014206976 00000100:00100000:2.0:1788581026.439595:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788581026.439615:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:5874:x1875463014206976:12345-0@lo:101: 00010000:00010000:2.0:1788581026.439631:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581026.439653:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821cf800/0xf54e3944c2a6ff14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6ff0d expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.439678:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821cf800/0xf54e3944c2a6ff14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6ff0d expref: 15 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.439688:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821cf800/0xf54e3944c2a6ff14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6ff0d expref: 15 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.439708:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf800, rc 0) 00000100:00100000:2.0:1788581026.439778:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014206976:12345-0@lo:101: Request processed in 173us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581026.439784:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788581026.439989:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014206976:0@lo:101: 00010000:00010000:1.0:1788581026.440007:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6ff0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff14 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581026.440017:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6ff0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6ff14 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581026.440082:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014207104:0@lo:501: 00000100:00100000:1.0:1788581026.440126:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581026.440157:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581026.440417:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014207104 00000100:00100000:2.0:1788581026.440423:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014207104 00000100:00100000:2.0:1788581026.440448:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788581026.440456:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014207104:12345-0@lo:501: 00000100:00100000:2.0:1788581026.440739:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014207104:12345-0@lo:501: Request processed in 283us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581026.440747:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788581026.440980:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014207104:0@lo:501: 00000100:00100000:1.0:1788581026.441017:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014207232:0@lo:503: 00000100:00100000:1.0:1788581026.441059:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581026.441092:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581026.441117:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014207232 00000100:00100000:1.0:1788581026.441121:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014207232 00000100:00100000:1.0:1788581026.441143:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788581026.441150:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014207232:12345-0@lo:503: 00000100:00100000:1.0:1788581026.441598:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014207232:12345-0@lo:503: Request processed in 447us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581026.441616:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788581026.441661:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014207232:0@lo:503: 00000100:00100000:1.0:1788581026.442083:0:8140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8140:1875463014207360:0@lo:502: 00000100:00100000:1.0:1788581026.442197:0:8140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581026.442225:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014207360 00000100:00100000:1.0:1788581026.442230:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014207360 00000100:00100000:1.0:1788581026.442282:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788581026.442435:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:8140:x1875463014207360:12345-0@lo:502: 00000100:00100000:1.0:1788581026.442839:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:8140:x1875463014207360:12345-0@lo:502: Request processed in 549us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581026.442922:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788581026.442963:0:8140:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05900 going to sleep for 11 seconds 00000100:00100000:1.0:1788581026.442981:0:8140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8140:1875463014207360:0@lo:502: 00000020:01000000:1.0:1788581026.443013:0:8140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581026.443022:0:8140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581026.443025:0:8140:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788581026.443038:0:8140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788581026.443041:0:8140:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788581026.443061:0:8140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8140:1875463014207488:0@lo:502: 00000100:00100000:1.0:1788581026.443094:0:8140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581026.443219:0:8140:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05900 going to sleep for 11 seconds 00000100:00100000:3.0:1788581026.443566:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014207488 00000100:00100000:3.0:1788581026.443574:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014207488 00000100:00100000:3.0:1788581026.443737:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788581026.443747:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:8140:x1875463014207488:12345-0@lo:502: 00000100:00100000:3.0:1788581026.444154:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:8140:x1875463014207488:12345-0@lo:502: Request processed in 408us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581026.444161:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788581026.444452:0:8140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8140:1875463014207488:0@lo:502: 00000020:01000000:0.0:1788581026.444544:0:8140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581026.444556:0:8140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581026.444558:0:8140:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788581026.444564:0:8140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788581026.444915:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788581026.444934:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788581026.444944:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6ff0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff14 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581026.444955:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6ff0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff14 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581026.444965:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788581026.444967:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91904733b800 from 30 10000000:01000000:1.0:1788581026.444970:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788581026.444996:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6ff1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581026.445004:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6ff1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581026.445014:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6ff1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581026.445029:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014207616:0@lo:101: 00000100:00100000:1.0:1788581026.445067:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581026.445095:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05900 going to sleep for 11 seconds 00000100:00100000:2.0:1788581026.445225:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014207616 00000100:00100000:2.0:1788581026.445231:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014207616 00000100:00100000:2.0:1788581026.445388:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788581026.445397:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014207616:12345-0@lo:101: 00010000:00010000:2.0:1788581026.445409:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581026.445421:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821ce800/0xf54e3944c2a6ff22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6ff1b expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.445442:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821ce800/0xf54e3944c2a6ff22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6ff1b expref: 16 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.445452:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821ce800/0xf54e3944c2a6ff22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6ff1b expref: 16 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.445460:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce800, rc 0) 00000100:00100000:2.0:1788581026.445529:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014207616:12345-0@lo:101: Request processed in 134us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581026.445535:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788581026.445794:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014207616:0@lo:101: 00010000:00010000:0.0:1788581026.445808:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6ff1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff22 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581026.445817:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6ff1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6ff22 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581026.445937:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014207744:0@lo:501: 00000100:00100000:0.0:1788581026.445963:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.446041:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581026.446069:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014207744 00000100:00100000:2.0:1788581026.446083:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014207744 00000100:00100000:2.0:1788581026.446197:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788581026.446205:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014207744:12345-0@lo:501: 00000100:00100000:2.0:1788581026.446553:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014207744:12345-0@lo:501: Request processed in 348us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581026.446560:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788581026.446628:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014207744:0@lo:501: 00000100:00100000:0.0:1788581026.446658:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014207872:0@lo:503: 00000100:00100000:0.0:1788581026.446704:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.447085:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581026.447191:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014207872 00000100:00100000:1.0:1788581026.447202:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014207872 00000100:00100000:0.0:1788581026.447342:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788581026.447348:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014207872:12345-0@lo:503: 00000100:00100000:0.0:1788581026.447511:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014207872:12345-0@lo:503: Request processed in 162us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581026.447518:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788581026.447556:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014207872:0@lo:503: 00000100:00100000:0.0:1788581026.447771:0:8141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8141:1875463014208000:0@lo:502: 00000100:00100000:0.0:1788581026.447814:0:8141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.447837:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014208000 00000100:00100000:0.0:1788581026.447840:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014208000 00000100:00100000:0.0:1788581026.448114:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788581026.448122:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:8141:x1875463014208000:12345-0@lo:502: 00000100:00100000:0.0:1788581026.448334:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:8141:x1875463014208000:12345-0@lo:502: Request processed in 212us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581026.448342:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788581026.448384:0:8141:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581026.448397:0:8141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8141:1875463014208000:0@lo:502: 00000100:00100000:0.0:1788581026.448440:0:8141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8141:1875463014208128:0@lo:502: 00000100:00100000:0.0:1788581026.448472:0:8141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.448495:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014208128 00000100:00100000:0.0:1788581026.448499:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014208128 00000100:00100000:0.0:1788581026.448515:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788581026.448521:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:8141:x1875463014208128:12345-0@lo:502: 00000100:00100000:0.0:1788581026.448649:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:8141:x1875463014208128:12345-0@lo:502: Request processed in 127us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581026.448655:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788581026.448683:0:8141:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581026.448705:0:8141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8141:1875463014208128:0@lo:502: 00000040:00080000:0.0:1788581026.448731:0:8141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788581026.448779:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788581026.448794:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788581026.448803:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6ff1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff22 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581026.448824:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6ff1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff22 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581026.448833:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788581026.448836:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91904733b800 from 5 10000000:01000000:0.0:1788581026.448838:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788581026.449201:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581026.449211:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581026.449219:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581026.449231:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014208256:0@lo:101: 00000100:00100000:0.0:1788581026.449343:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.449372:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581026.449388:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014208256 00000100:00100000:0.0:1788581026.449392:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014208256 00000100:00100000:0.0:1788581026.449413:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788581026.449420:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014208256:12345-0@lo:101: 00010000:00010000:0.0:1788581026.449428:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581026.449442:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919040030600/0xf54e3944c2a6ff30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6ff29 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581026.449465:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919040030600/0xf54e3944c2a6ff30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6ff29 expref: 17 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581026.449487:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919040030600/0xf54e3944c2a6ff30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6ff29 expref: 17 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581026.449497:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919040030600, rc 0) 00000100:00100000:0.0:1788581026.449531:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014208256:12345-0@lo:101: Request processed in 111us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581026.449537:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788581026.449572:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014208256:0@lo:101: 00010000:00010000:0.0:1788581026.449584:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff30 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581026.449592:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6ff30 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581026.449781:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014208384:0@lo:256: 00000100:00100000:0.0:1788581026.449813:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.449829:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581026.449841:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014208384 00000100:00100000:0.0:1788581026.449844:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014208384 00000100:00100000:0.0:1788581026.449936:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788581026.449942:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014208384:12345-0@lo:256: 20000000:01000000:0.0:1788581026.449953:0:5869:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788581026.449970:0:5869:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788581026.449973:0:5869:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788581026.450050:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014208384:12345-0@lo:256: Request processed in 108us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581026.450057:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788581026.450094:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014208384:0@lo:256: 10000000:01000000:0.0:1788581026.450512:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788581026.450520:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff30 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581026.450530:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff30 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581026.450538:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788581026.450540:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788581026.450543:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788581026.450563:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040031a00/0xf54e3944c2a6ff37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581026.450571:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919040031a00/0xf54e3944c2a6ff37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581026.450578:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919040031a00/0xf54e3944c2a6ff37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581026.450592:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014208512:0@lo:101: 00000100:00100000:0.0:1788581026.450788:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.450825:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c9180 going to sleep for 11 seconds 00000100:00100000:2.0:1788581026.450952:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014208512 00000100:00100000:2.0:1788581026.450959:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014208512 00000100:00100000:2.0:1788581026.450988:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788581026.450996:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014208512:12345-0@lo:101: 00010000:00010000:2.0:1788581026.451005:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581026.451016:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821cf000/0xf54e3944c2a6ff3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6ff37 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.451034:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821cf000/0xf54e3944c2a6ff3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6ff37 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.451042:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821cf000/0xf54e3944c2a6ff3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6ff37 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.451051:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf000, rc 0) 00000100:00100000:2.0:1788581026.451090:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014208512:12345-0@lo:101: Request processed in 94us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581026.451096:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788581026.451206:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014208512:0@lo:101: 00010000:00010000:0.0:1788581026.451218:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919040031a00/0xf54e3944c2a6ff37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff3e expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581026.451226:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919040031a00/0xf54e3944c2a6ff37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6ff3e expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581026.451487:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014208640:0@lo:501: 00000100:00100000:0.0:1788581026.451515:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.451547:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c9180 going to sleep for 11 seconds 00000100:00100000:2.0:1788581026.451594:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014208640 00000100:00100000:2.0:1788581026.451599:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014208640 00000100:00100000:2.0:1788581026.451811:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788581026.451820:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014208640:12345-0@lo:501: 00000100:00100000:2.0:1788581026.452229:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014208640:12345-0@lo:501: Request processed in 410us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581026.452273:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788581026.452371:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014208640:0@lo:501: 00000100:00100000:0.0:1788581026.452406:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014208768:0@lo:503: 00000100:00100000:0.0:1788581026.452446:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.452859:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c9180 going to sleep for 11 seconds 00000100:00100000:3.0:1788581026.452978:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014208768 00000100:00100000:3.0:1788581026.452985:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014208768 00000100:00100000:3.0:1788581026.453017:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788581026.453024:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014208768:12345-0@lo:503: 00000100:00100000:3.0:1788581026.453422:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014208768:12345-0@lo:503: Request processed in 397us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581026.453430:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788581026.453787:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014208768:0@lo:503: 00000100:00100000:0.0:1788581026.454440:0:8142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8142:1875463014208896:0@lo:502: 00000100:00100000:0.0:1788581026.454494:0:8142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.454642:0:8142:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581026.455188:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014208896 00000100:00100000:1.0:1788581026.455196:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014208896 00000100:00100000:1.0:1788581026.455268:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788581026.455280:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:8142:x1875463014208896:12345-0@lo:502: 00000100:00100000:1.0:1788581026.456087:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:8142:x1875463014208896:12345-0@lo:502: Request processed in 806us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581026.456097:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788581026.456676:0:8142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8142:1875463014208896:0@lo:502: 00000020:01000000:0.0:1788581026.456797:0:8142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788581026.456807:0:8142:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788581026.456816:0:8142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581026.456819:0:8142:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788581026.456825:0:8142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788581026.456829:0:8142:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.113@tcp to nid 0x20000c0a8c971 (192.168.201.113@tcp) 00000020:01000000:0.0:1788581026.456924:0:8142:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788581026.456928:0:8142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788581026.456946:0:8142:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9190762119b8) 00000020:00000080:0.0:1788581026.456972:0:8142:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788581026.456977:0:8142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788581026.457075:0:8142:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788581026.457080:0:8142:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788581026.457091:0:8142:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf54e3944c2a6ff4c 00010000:00080000:0.0:1788581026.457193:0:8142:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9190485eb000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.113@tcp at head 00010000:00010000:0.0:1788581026.457574:0:8142:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788581026.458510:0:8142:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788581026.458528:0:8142:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788581026.459581:0:8142:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788581026.460069:0:8142:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788581026.460208:0:8142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788581026.460553:0:8142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788581026.461481:0:8143:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788581026.461487:0:8143:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788581026.463047:0:8142:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788581026.463063:0:8142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788581026.463101:0:8142:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788581026.463208:0:8142:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf54e3944c2a6ff53 00000100:00080000:0.0:1788581026.463226:0:8142:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788581026.463232:0:8142:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9190485eb000 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:0.0:1788581026.463491:0:8142:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919075b74a80 x1875463014209024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581026.463554:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014209024:0@lo:8: 00000100:00080000:0.0:1788581026.463675:0:8142:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788581026.463957:0:8142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581026.463964:0:8142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581026.463966:0:8142:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788581026.463970:0:8142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581026.463975:0:8142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581026.463976:0:8142:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788581026.463980:0:8142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788581026.463982:0:8142:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788581026.464015:0:8142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b76a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8142:1875463014209152:0@lo:502: 00000100:00100000:3.0:1788581026.464460:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014209280:0@lo:400: 00000100:00100000:3.0:1788581026.464495:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.464543:0:8142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.464585:0:8142:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581026.464778:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014209664:0@lo:400: 00000100:00100000:0.0:1788581026.464828:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581026.465025:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581026.465062:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014209024 00000100:00100000:1.0:1788581026.465068:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014209024 00000100:00100000:1.0:1788581026.465102:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788581026.465124:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3337:x1875463014209024:12345-0@lo:8: 00010000:00080000:1.0:1788581026.465152:0:6723:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:1.0:1788581026.465183:0:6723:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf54e3944c2a6ff5a 00002000:00100000:1.0:1788581026.465196:0:6723:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91907f901800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788581026.465201:0:6723:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788581026.465205:0:6723:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788581026.465479:0:6723:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788581026.465653:0:6723:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788581026.465682:0:6723:0:(import.c:65:import_set_state_nolock()) ffff91907f907800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581026.465968:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3337:x1875463014209024:12345-0@lo:8: Request processed in 842us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581026.465977:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788581026.466046:0:3337:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919075b74a80 x1875463014209024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581026.466074:0:3337:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788581026.466084:0:3337:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788581026.466094:0:3337:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788581026.466100:0:3337:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788581026.466171:0:3337:0:(import.c:65:import_set_state_nolock()) ffff9190485eb000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788581026.466189:0:3337:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788581026.466195:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014209024:0@lo:8: 00000100:00100000:1.0:1788581026.466227:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014209152 00000100:00100000:1.0:1788581026.466265:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014209152 00000100:00100000:1.0:1788581026.466374:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788581026.466383:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:8142:x1875463014209152:12345-0@lo:502: 00000100:00100000:1.0:1788581026.466688:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:8142:x1875463014209152:12345-0@lo:502: Request processed in 306us (2143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581026.466706:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788581026.466920:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014209536:0@lo:400: 00000100:00100000:0.0:1788581026.466956:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.466999:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581026.467006:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014209408:0@lo:400: 00000100:00100000:0.0:1788581026.467032:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.467065:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014209280 00000100:00100000:0.0:1788581026.467070:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014209280 00000100:00100000:0.0:1788581026.467094:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014209664 00000100:00100000:0.0:1788581026.467097:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014209664 00000100:00100000:0.0:1788581026.467129:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014209408 00000100:00100000:0.0:1788581026.467132:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014209408 00000100:00100000:0.0:1788581026.467148:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788581026.467154:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014209280:12345-0@lo:400: 00000100:00100000:1.0:1788581026.467444:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014209536 00000100:00100000:1.0:1788581026.467449:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014209536 00000100:00100000:1.0:1788581026.467477:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581026.467484:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014209536:12345-0@lo:400: 00000100:00100000:1.0:1788581026.467524:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014209536:12345-0@lo:400: Request processed in 40us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581026.467530:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788581026.467547:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581026.467551:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788581026.467574:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919048581180 x1875463014209536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581026.467587:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014209536:0@lo:400: 00000100:00100000:1.0:1788581026.468418:0:8142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b76a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8142:1875463014209152:0@lo:502: 00000020:01000000:1.0:1788581026.468458:0:8142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581026.468465:0:8142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581026.468467:0:8142:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788581026.468472:0:8142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:2.0:1788581026.468739:0:8143:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788581026.469018:0:8143:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 242709773965ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788581026.469683:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014209280:12345-0@lo:400: Request processed in 2525us (5183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581026.469705:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581026.469876:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581026.469890:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014209664:12345-0@lo:400: 00000100:00100000:2.0:1788581026.469963:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014209664:12345-0@lo:400: Request processed in 78us (5134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581026.469969:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581026.469988:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788581026.469995:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014209408:12345-0@lo:400: 00000100:00100000:2.0:1788581026.470027:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014209408:12345-0@lo:400: Request processed in 33us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581026.470034:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788581026.473204:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919048580e00 x1875463014209408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581026.473223:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014209408:0@lo:400: 00010000:00080000:3.0:1788581026.473862:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919048581880 x1875463014209280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581026.473875:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014209280:0@lo:400: 00000020:01000000:2.0:1788581026.475507:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788581026.475546:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788581026.475557:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040031a00/0xf54e3944c2a6ff37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff3e expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.475569:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919040031a00/0xf54e3944c2a6ff37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff3e expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581026.475580:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788581026.475582:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff919047dccd28 from 1 10000000:01000000:2.0:1788581026.475586:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788581026.475635:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821cf200/0xf54e3944c2a6ff61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.475656:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff9190821cf200/0xf54e3944c2a6ff61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581026.475670:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff9190821cf200/0xf54e3944c2a6ff61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581026.475708:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014209792:0@lo:101: 00000100:00100000:2.0:1788581026.475972:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581026.476028:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048207180 going to sleep for 11 seconds 00000100:00100000:1.0:1788581026.476097:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014209792 00000100:00100000:1.0:1788581026.476115:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014209792 00000100:00100000:1.0:1788581026.476174:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788581026.476184:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014209792:12345-0@lo:101: 00010000:00010000:1.0:1788581026.476197:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581026.476210:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6ff68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6ff61 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581026.476234:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6ff68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6ff61 expref: 19 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581026.476263:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6ff68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6ff61 expref: 19 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581026.476272:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9c00, rc 0) 00000100:00100000:1.0:1788581026.476435:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014209792:12345-0@lo:101: Request processed in 251us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581026.476441:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788581026.476490:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048582d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014209792:0@lo:101: 00010000:00010000:1.0:1788581026.476521:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff9190821cf200/0xf54e3944c2a6ff61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff68 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581026.476530:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff9190821cf200/0xf54e3944c2a6ff61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6ff68 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581026.476591:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014209920:0@lo:501: 00000100:00100000:1.0:1788581026.476631:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581026.476646:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581026.476660:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014209920 00000100:00100000:1.0:1788581026.476664:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014209920 00000100:00100000:1.0:1788581026.476688:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788581026.476707:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014209920:12345-0@lo:501: 00000100:00100000:1.0:1788581026.477200:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014209920:12345-0@lo:501: Request processed in 493us (567us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788581026.477209:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788581026.477264:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014209920:0@lo:501: 10000000:01000000:1.0:1788581026.477355:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788581026.477362:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821cf200/0xf54e3944c2a6ff61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff68 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581026.477371:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff9190821cf200/0xf54e3944c2a6ff61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff68 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788581026.478701:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919048581f80 x1875463014209664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581026.478786:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014209664:0@lo:400: 00000004:00080000:0.0:1788581026.523087:0:7683:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788581026.549880:0:8144:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788581026.549915:0:8144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8144:1875463014210176:0@lo:7: 00000100:00100000:3.0:1788581026.549987:0:8144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581026.550046:0:8144:0:(client.c:2715:ptlrpc_set_wait()) set ffff91904510a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581026.550063:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014210048:0@lo:13: 00000100:00100000:3.0:1788581026.550087:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581026.550281:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014210176 00000100:00100000:3.0:1788581026.550300:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014210176 00000100:00100000:3.0:1788581026.550357:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788581026.550367:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8144:x1875463014210176:12345-0@lo:7: 00000100:00080000:2.0:1788581026.552410:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581026.552441:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014210048 00000100:00100000:2.0:1788581026.552449:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014210048 00000100:00100000:2.0:1788581026.552499:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788581026.552509:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3341:x1875463014210048:12345-0@lo:13: 00002000:00000024:2.0:1788581026.552537:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788581026.552615:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3341:x1875463014210048:12345-0@lo:13: Request processed in 107us (2526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581026.552622:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788581026.552671:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c60df80 x1875463014210048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581026.552781:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014210048:0@lo:13: 00002000:00080000:3.0:1788581026.558997:0:6725:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788581026.559005:0:6725:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00010000:00080000:0.0:1788581026.559267:0:8144:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c60d180 x1875463014210176/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788581042 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581026.559296:0:8144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8144:1875463014210176:0@lo:7: 00000004:00080000:0.0:1788581026.559313:0:8144:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788581026.559365:0:8144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8144:1875463014210304:0@lo:5: 00000100:00100000:0.0:1788581026.559413:0:8144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.559483:0:8144:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581026.559615:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8144:x1875463014210176:12345-0@lo:7: Request processed in 8739us (9116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581026.559626:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788581026.559651:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014210304 00000100:00100000:3.0:1788581026.559658:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014210304 00000100:00100000:3.0:1788581026.559701:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788581026.559790:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8144:x1875463014210304:12345-0@lo:5: 00002000:00080000:3.0:1788581026.559816:0:6725:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788581026.559820:0:6725:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788581026.560181:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8144:x1875463014210304:12345-0@lo:5: Request processed in 393us (767us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788581026.560189:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788581026.560397:0:8144:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919075b74e00 x1875463014210304/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581042 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581026.560410:0:8144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8144:1875463014210304:0@lo:5: 00000004:00080000:0.0:1788581026.560419:0:8144:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788581026.560449:0:8144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b76a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8144:1875463014210432:0@lo:700: 00000100:00100000:0.0:1788581026.560490:0:8144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581026.560524:0:8144:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581026.560585:0:6731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014210432 00000100:00100000:1.0:1788581026.560591:0:6731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014210432 00000100:00100000:1.0:1788581026.560629:0:6731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581026.560638:0:6731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8144:x1875463014210432:12345-0@lo:700: 00000100:00100000:1.0:1788581026.560674:0:6731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6731:1875463014210560:0@lo:700: 00000100:00100000:1.0:1788581026.560788:0:6731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581026.560824:0:6731:0:(client.c:2715:ptlrpc_set_wait()) set ffff919042bdc540 going to sleep for 11 seconds 00000100:00100000:0.0:1788581026.560939:0:5883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014210560 00000100:00100000:0.0:1788581026.560944:0:5883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014210560 00000100:00100000:0.0:1788581026.560971:0:5883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788581026.560977:0:5883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6731:x1875463014210560:12345-0@lo:700: 40000000:02000000:2.0:1788581026.597564:0:5883:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1788581026.604830:0:5883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6731:x1875463014210560:12345-0@lo:700: Request processed in 43846us (44036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581026.604864:0:5883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788581026.605009:0:6731:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190779cdf80 x1875463014210560/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788581042 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581026.605025:0:6731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6731:1875463014210560:0@lo:700: 40000000:02000000:1.0:1788581026.605039:0:6731:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1788581026.675841:0:6731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8144:x1875463014210432:12345-0@lo:700: Request processed in 115194us (115341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581026.675983:0:6731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788581026.676051:0:8144:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919075b76a00 x1875463014210432/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788581042 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581026.676067:0:8144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b76a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8144:1875463014210432:0@lo:700: 00000001:00100000:0.0:1788581026.677213:0:7696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788581026.677227:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000004:02000040:3.0:1788581026.710180:0:8144:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788581026.715589:0:8144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8144:1875463014210688:0@lo:5: 00000100:00100000:2.0:1788581026.715659:0:8144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581026.715915:0:8144:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048207cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581026.716044:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014210688 00000100:00100000:3.0:1788581026.716053:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014210688 00000100:00100000:3.0:1788581026.716209:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581026.716220:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8144:x1875463014210688:12345-0@lo:5: 00002000:00080000:3.0:1788581026.724180:0:6725:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788581026.724205:0:6725:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788581026.728485:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8144:x1875463014210688:12345-0@lo:5: Request processed in 12260us (12819us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788581026.728499:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788581026.728612:0:8144:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919048581f80 x1875463014210688/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581042 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581026.728635:0:8144:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788581026.728652:0:8144:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff919048581f80 x1875463014210688/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581042 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581026.728665:0:8144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8144:1875463014210688:0@lo:5: 00000004:00080000:2.0:1788581026.728680:0:8144:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1788581026.799726:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581027.823596:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581028.850405:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581028.976435:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014210816:0@lo:13: 00000100:00100000:2.0:1788581028.976506:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581028.976629:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014210816 00000100:00100000:1.0:1788581028.976637:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014210816 00000100:00100000:1.0:1788581028.976715:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788581028.976724:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014210816:12345-0@lo:13: 00002000:00000024:1.0:1788581028.976760:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581028.976806:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014210816:12345-0@lo:13: Request processed in 83us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581028.976813:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788581028.976943:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788581028.976975:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190779cdf80 x1875463014210816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581028.976994:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014210816:0@lo:13: 00000001:00080000:0.0:1788581029.290186:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788581029.871643:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581029.917906:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581029.918408:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995312768 00000100:00100000:1.0:1788581029.918419:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995312768 00000100:00100000:1.0:1788581029.918462:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 112 00000100:00100000:1.0:1788581029.918471:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2371:x1875462995312768:12345-192.168.201.13@tcp:250: 00010000:00080000:1.0:1788581029.918500:0:5871:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from de69dcf2-c51b-4af8-b9fa-cef1f40146a6@192.168.201.13@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:1.0:1788581029.918529:0:5871:0:(genops.c:1385:class_connect()) connect: client de69dcf2-c51b-4af8-b9fa-cef1f40146a6, cookie 0xf54e3944c2a6ff6f 00000100:00080000:1.0:1788581029.918761:0:5871:0:(import.c:65:import_set_state_nolock()) ffff91907f900800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581029.918934:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+5:2371:x1875462995312768:12345-192.168.201.13@tcp:250: Request processed in 462us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581029.918958:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 112 00000100:00100000:0.0:1788581029.940437:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581029.940615:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995312896 00000100:00100000:1.0:1788581029.940625:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995312896 00000100:00100000:1.0:1788581029.940689:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 113 00000100:00100000:1.0:1788581029.940700:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+5:5599:x1875462995312896:12345-192.168.201.13@tcp:101: 00010000:00010000:1.0:1788581029.940715:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581029.940732:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919044ca8600/0xf54e3944c2a6ff76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8edd expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581029.940759:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca8600/0xf54e3944c2a6ff76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8edd expref: 6 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581029.940771:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919044ca8600/0xf54e3944c2a6ff76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8edd expref: 6 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581029.940779:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8600, rc 0) 00000100:00100000:1.0:1788581029.940838:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+6:5599:x1875462995312896:12345-192.168.201.13@tcp:101: Request processed in 140us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581029.940845:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 113 00000100:00100000:2.0:1788581029.948748:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581029.948788:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995313024 00000100:00100000:2.0:1788581029.948798:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995313024 00000100:00100000:2.0:1788581029.948849:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 114 00000100:00100000:2.0:1788581029.948860:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+6:5599:x1875462995313024:12345-192.168.201.13@tcp:501: 00000100:00100000:2.0:1788581029.949201:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+6:5599:x1875462995313024:12345-192.168.201.13@tcp:501: Request processed in 341us (461us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581029.949209:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 114 00000100:00100000:0.0:1788581029.960584:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581029.960745:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995313152 00000100:00100000:1.0:1788581029.960756:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995313152 00000100:00100000:1.0:1788581029.960813:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 115 00000100:00100000:1.0:1788581029.960823:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+6:5599:x1875462995313152:12345-192.168.201.13@tcp:101: 00010000:00010000:1.0:1788581029.960838:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581029.960854:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919044ca8c00/0xf54e3944c2a6ff7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8ee4 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581029.960900:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca8c00/0xf54e3944c2a6ff7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8ee4 expref: 7 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581029.960911:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919044ca8c00/0xf54e3944c2a6ff7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8ee4 expref: 7 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581029.960921:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8c00, rc 0) 00000100:00100000:1.0:1788581029.960979:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+7:5599:x1875462995313152:12345-192.168.201.13@tcp:101: Request processed in 157us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581029.960985:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 115 00000100:00100000:0.0:1788581029.966530:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581029.966677:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995313280 00000100:00100000:1.0:1788581029.966686:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995313280 00000100:00100000:1.0:1788581029.966730:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 116 00000100:00100000:1.0:1788581029.966738:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+7:5599:x1875462995313280:12345-192.168.201.13@tcp:501: 00000100:00100000:1.0:1788581029.966982:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+8:5599:x1875462995313280:12345-192.168.201.13@tcp:501: Request processed in 242us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581029.966990:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 116 00000100:00100000:2.0:1788581029.971442:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581029.971519:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995313408 00000100:00100000:1.0:1788581029.971530:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995313408 00000100:00100000:1.0:1788581029.971594:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 117 00000100:00100000:1.0:1788581029.971605:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+8:5599:x1875462995313408:12345-192.168.201.13@tcp:503: 00000100:00100000:1.0:1788581029.971972:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+8:5599:x1875462995313408:12345-192.168.201.13@tcp:503: Request processed in 368us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581029.971980:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 117 00000100:00100000:3.0:1788581029.991095:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581029.991651:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995313536 00000100:00100000:1.0:1788581029.991669:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995313536 00000100:00100000:1.0:1788581029.991722:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 118 00000100:00100000:1.0:1788581029.991731:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+8:5617:x1875462995313536:12345-192.168.201.13@tcp:502: 00000100:00100000:1.0:1788581029.992083:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+8:5617:x1875462995313536:12345-192.168.201.13@tcp:502: Request processed in 351us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581029.992091:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 118 00000100:00100000:2.0:1788581030.049673:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581030.049759:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995313664 00000100:00100000:3.0:1788581030.049769:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995313664 00000100:00100000:3.0:1788581030.050358:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 119 00000100:00100000:3.0:1788581030.050380:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+8:5617:x1875462995313664:12345-192.168.201.13@tcp:502: 00000100:00100000:3.0:1788581030.050675:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+8:5617:x1875462995313664:12345-192.168.201.13@tcp:502: Request processed in 306us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581030.050683:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 119 00000100:00100000:3.0:1788581030.064667:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581030.064708:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995313792 00000100:00100000:3.0:1788581030.064718:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995313792 00000100:00100000:3.0:1788581030.064765:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 120 00000100:00100000:3.0:1788581030.064775:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+8:5599:x1875462995313792:12345-192.168.201.13@tcp:101: 00010000:00010000:3.0:1788581030.064793:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581030.064811:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190414b2000/0xf54e3944c2a6ff84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8f0e expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581030.064839:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190414b2000/0xf54e3944c2a6ff84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f0e expref: 9 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581030.064849:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190414b2000/0xf54e3944c2a6ff84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f0e expref: 9 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581030.064858:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190414b2000, rc 0) 00000100:00100000:3.0:1788581030.064919:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+9:5599:x1875462995313792:12345-192.168.201.13@tcp:101: Request processed in 145us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581030.064926:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 120 00000100:00100000:2.0:1788581030.093171:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581030.093392:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995313920 00000100:00100000:3.0:1788581030.093410:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995313920 00000100:00100000:3.0:1788581030.093483:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 121 00000100:00100000:3.0:1788581030.093494:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+9:5599:x1875462995313920:12345-192.168.201.13@tcp:256: 20000000:01000000:3.0:1788581030.093516:0:5869:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788581030.093532:0:5869:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788581030.093536:0:5869:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788581030.093699:0:5869:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788581030.093702:0:5869:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788581030.098848:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+9:5599:x1875462995313920:12345-192.168.201.13@tcp:256: Request processed in 5343us (5673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581030.098864:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 121 00000100:00100000:2.0:1788581030.107345:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581030.108382:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995314048 00000100:00100000:3.0:1788581030.108394:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995314048 00000100:00100000:3.0:1788581030.108469:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 122 00000100:00100000:3.0:1788581030.108481:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+9:5599:x1875462995314048:12345-192.168.201.13@tcp:101: 00010000:00010000:3.0:1788581030.108501:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581030.108520:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6ff8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8f15 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581030.108762:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6ff8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f15 expref: 10 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581030.108775:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6ff8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f15 expref: 10 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581030.108785:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190414b3400, rc 0) 00000100:00100000:3.0:1788581030.108838:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:5599:x1875462995314048:12345-192.168.201.13@tcp:101: Request processed in 359us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581030.108844:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 122 00000100:00100000:2.0:1788581030.110839:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581030.110926:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995314176 00000100:00100000:3.0:1788581030.110935:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995314176 00000100:00100000:3.0:1788581030.110996:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 123 00000100:00100000:3.0:1788581030.111160:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:5599:x1875462995314176:12345-192.168.201.13@tcp:501: 00000100:00100000:3.0:1788581030.111817:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:5599:x1875462995314176:12345-192.168.201.13@tcp:501: Request processed in 659us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581030.111826:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 123 00000100:00100000:2.0:1788581030.120261:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581030.121422:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995314304 00000100:00100000:3.0:1788581030.121436:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995314304 00000100:00100000:3.0:1788581030.121504:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 124 00000100:00100000:3.0:1788581030.121515:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:5599:x1875462995314304:12345-192.168.201.13@tcp:503: 00000100:00100000:3.0:1788581030.121937:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:5599:x1875462995314304:12345-192.168.201.13@tcp:503: Request processed in 422us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581030.121945:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 124 00000100:00100000:2.0:1788581030.125732:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581030.125853:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995314432 00000100:00100000:3.0:1788581030.125862:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995314432 00000100:00100000:3.0:1788581030.125920:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 125 00000100:00100000:3.0:1788581030.125929:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:5621:x1875462995314432:12345-192.168.201.13@tcp:502: 00000100:00100000:3.0:1788581030.126201:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:5621:x1875462995314432:12345-192.168.201.13@tcp:502: Request processed in 271us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581030.126210:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 125 00000100:00100000:2.0:1788581030.135388:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581030.135531:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995314560 00000100:00100000:1.0:1788581030.135541:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995314560 00000100:00100000:1.0:1788581030.135599:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 126 00000100:00100000:1.0:1788581030.135609:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:5621:x1875462995314560:12345-192.168.201.13@tcp:502: 00000100:00100000:1.0:1788581030.135854:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:5621:x1875462995314560:12345-192.168.201.13@tcp:502: Request processed in 246us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581030.135862:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 126 00000100:00100000:2.0:1788581030.140959:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581030.141111:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995314688 00000100:00100000:0.0:1788581030.141121:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995314688 00000100:00100000:0.0:1788581030.141175:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:0.0:1788581030.141184:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2371:x1875462995314688:12345-192.168.201.13@tcp:38: 00010000:00080000:0.0:1788581030.141214:0:5877:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1788581030.141301:0:5877:0:(genops.c:1385:class_connect()) connect: client 11f1870a-1d9b-4af2-bb25-e81f8742df75, cookie 0xf54e3944c2a6ff92 00000004:00100000:0.0:1788581030.141330:0:5877:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788581030.141336:0:5877:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788581030.237723:0:5877:0:(import.c:65:import_set_state_nolock()) ffff9190485ee800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581030.237815:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2371:x1875462995314688:12345-192.168.201.13@tcp:38: Request processed in 96629us (96864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581030.237827:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 4 00010000:00010000:0.0:1788581030.895480:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581031.246044:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581031.246317:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581031.246431:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995314816 00000100:00100000:0.0:1788581031.246437:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995314944 00000100:00100000:1.0:1788581031.246442:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995314816 00000100:00100000:0.0:1788581031.246445:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995314944 00000100:00100000:0.0:1788581031.246529:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:0.0:1788581031.246541:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:5599:x1875462995314944:12345-192.168.201.13@tcp:41: 00000004:00000024:0.0:1788581031.246586:0:5876:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788581031.246731:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:5599:x1875462995314944:12345-192.168.201.13@tcp:41: Request processed in 192us (414us total) trans 0 rc 0/0 00000100:00080000:2.0:1788581031.246752:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581031.247371:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:0.0:1788581031.247397:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:0.0:1788581031.247407:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:0:x1875462995314816:12345-192.168.201.13@tcp:41: 00000004:00000024:0.0:1788581031.247423:0:5876:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788581031.247585:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:0:x1875462995314816:12345-192.168.201.13@tcp:41: Request processed in 180us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581031.247593:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:2.0:1788581031.250864:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581031.250966:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995315072 00000100:00100000:0.0:1788581031.250977:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995315072 00000100:00100000:0.0:1788581031.251041:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:0.0:1788581031.251052:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:5599:x1875462995315072:12345-192.168.201.13@tcp:40: 00000100:00100000:0.0:1788581031.251149:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:5599:x1875462995315072:12345-192.168.201.13@tcp:40: Request processed in 98us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581031.251157:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:3.0:1788581031.255376:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581031.255472:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995315200 00000100:00100000:2.0:1788581031.255483:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995315200 00000100:00100000:2.0:1788581031.255533:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:2.0:1788581031.255541:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2371:x1875462995315200:12345-192.168.201.13@tcp:8: 00010000:00080000:2.0:1788581031.255570:0:6722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:2.0:1788581031.255598:0:6722:0:(genops.c:1385:class_connect()) connect: client 11f1870a-1d9b-4af2-bb25-e81f8742df75, cookie 0xf54e3944c2a6ff99 00002000:00100000:2.0:1788581031.255619:0:6722:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 11f1870a-1d9b-4af2-bb25-e81f8742df75/ffff91907630b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788581031.255654:0:6722:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788581031.255996:0:6722:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788581031.256026:0:6722:0:(import.c:65:import_set_state_nolock()) ffff91907630f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581031.256215:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2371:x1875462995315200:12345-192.168.201.13@tcp:8: Request processed in 673us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581031.256223:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:3.0:1788581031.258218:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581031.258305:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581031.258363:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995315456 00000100:00100000:0.0:1788581031.258371:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995315456 00000100:00100000:0.0:1788581031.258417:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 127 00000100:00100000:0.0:1788581031.258424:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2375:x1875462995315456:12345-192.168.201.13@tcp:400: 00000100:00100000:0.0:1788581031.258481:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2375:x1875462995315456:12345-192.168.201.13@tcp:400: Request processed in 58us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581031.258486:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 127 00000100:00100000:1.0:1788581031.259219:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995315328 00000100:00100000:1.0:1788581031.259228:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995315328 00000100:00100000:1.0:1788581031.259336:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:1.0:1788581031.259344:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2371:x1875462995315328:12345-192.168.201.13@tcp:8: 00010000:00080000:1.0:1788581031.259370:0:6725:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:1.0:1788581031.259405:0:6725:0:(genops.c:1385:class_connect()) connect: client 11f1870a-1d9b-4af2-bb25-e81f8742df75, cookie 0xf54e3944c2a6ffa0 00002000:00100000:1.0:1788581031.259418:0:6725:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 11f1870a-1d9b-4af2-bb25-e81f8742df75/ffff91907f902800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788581031.259442:0:6725:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788581031.261842:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581031.261924:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995315584 00000100:00100000:3.0:1788581031.261939:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995315584 00000100:00100000:3.0:1788581031.261985:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:3.0:1788581031.261995:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:5599:x1875462995315584:12345-192.168.201.13@tcp:33: 00002000:00080000:1.0:1788581031.262144:0:6725:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788581031.262177:0:6725:0:(import.c:65:import_set_state_nolock()) ffff91907f903000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581031.262239:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2371:x1875462995315328:12345-192.168.201.13@tcp:8: Request processed in 2894us (4026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581031.262272:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00000004:00080000:2.0:1788581031.280915:0:5879:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 18844us 00000004:00200000:2.0:1788581031.298792:0:5879:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788581031.298907:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:5599:x1875462995315584:12345-192.168.201.13@tcp:33: Request processed in 36908us (37069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581031.298922:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:1.0:1788581031.537579:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014211072:0@lo:400: 00000100:00100000:1.0:1788581031.537677:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581031.537758:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014211584:0@lo:400: 00000100:00100000:1.0:1788581031.537786:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581031.537822:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581031.537828:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014211200:0@lo:400: 00000100:00100000:1.0:1788581031.537851:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581031.537880:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014211584 00000100:00100000:1.0:1788581031.537887:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014211584 00000100:00100000:1.0:1788581031.537941:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788581031.537950:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014211584:12345-0@lo:400: 00000100:00100000:1.0:1788581031.538002:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014211584:12345-0@lo:400: Request processed in 54us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581031.538008:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788581031.538046:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c60c380 x1875463014211584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581031.538058:0:3340:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788581031.538074:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014211584:0@lo:400: 00000100:00100000:3.0:1788581031.538221:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014211072 00000100:00100000:3.0:1788581031.538226:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014211072 00000100:00100000:3.0:1788581031.538281:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014211200 00000100:00100000:3.0:1788581031.538284:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014211200 00000100:00100000:3.0:1788581031.538300:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788581031.538307:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014211072:12345-0@lo:400: 00000100:00100000:3.0:1788581031.538344:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014211072:12345-0@lo:400: Request processed in 38us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581031.538350:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788581031.538364:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788581031.538369:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014211200:12345-0@lo:400: 00000100:00100000:3.0:1788581031.538393:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014211200:12345-0@lo:400: Request processed in 24us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581031.538399:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788581031.538468:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014211328:0@lo:400: 00000100:00100000:2.0:1788581031.538496:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581031.538528:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788581031.538534:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014210944:0@lo:400: 00000100:00100000:2.0:1788581031.538560:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581031.538581:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3338:1875463014211456:0@lo:400: 00000100:00100000:2.0:1788581031.538621:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788581031.538651:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581031.538656:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581031.538663:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014211456 00000100:00100000:2.0:1788581031.538666:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014211456 00000100:00100000:2.0:1788581031.538692:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788581031.538697:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3338:x1875463014211456:12345-0@lo:400: 00000100:00100000:2.0:1788581031.538730:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3338:x1875463014211456:12345-0@lo:400: Request processed in 33us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581031.538735:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788581031.538748:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788581031.538764:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c60ce00 x1875463014211456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581031.538774:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3338:1875463014211456:0@lo:400: 00000100:00100000:2.0:1788581031.538790:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014211328 00000100:00100000:2.0:1788581031.538793:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014211328 00000100:00080000:2.0:1788581031.538808:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581031.538829:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788581031.538835:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014211328:12345-0@lo:400: 00000100:00100000:2.0:1788581031.538868:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014211328:12345-0@lo:400: Request processed in 34us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581031.538891:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788581031.538917:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c60f100 x1875463014211328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581031.538926:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014211328:0@lo:400: 00000100:00100000:3.0:1788581031.539077:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014210944 00000100:00100000:3.0:1788581031.539082:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014210944 00000100:00100000:3.0:1788581031.539117:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788581031.539124:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3338:x1875463014210944:12345-0@lo:400: 00000100:00100000:3.0:1788581031.539158:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3338:x1875463014210944:12345-0@lo:400: Request processed in 35us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581031.539164:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00080000:1.0:1788581031.541038:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c60e680 x1875463014211200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581031.541056:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014211200:0@lo:400: 00010000:00080000:1.0:1788581031.541071:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c60c000 x1875463014211072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581031.541103:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014211072:0@lo:400: 00000100:00100000:2.0:1788581031.541221:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014210944:0@lo:400: 00000100:00100000:3.0:1788581031.568677:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581031.568855:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995315712 00000100:00100000:2.0:1788581031.568866:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995315712 00000100:00100000:2.0:1788581031.568932:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:2.0:1788581031.568943:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:5639:x1875462995315712:12345-192.168.201.13@tcp:101: 00010000:00010000:2.0:1788581031.568964:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581031.569024:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a6ffa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8f3f expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581031.569094:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a6ffae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581031.569109:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a6ffae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581031.569124:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a6ffae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581031.569159:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788581031.569163:0:5876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788581031.569177:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a6ffae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581031.569203:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a6ffa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f3f expref: 8 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581031.569236:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a6ffae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f3f expref: 7 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581031.569295:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525600) 00010000:00010000:2.0:1788581031.569298:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788581031.569301:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb83000, rc 0) 00000100:00100000:2.0:1788581031.569376:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:5639:x1875462995315712:12345-192.168.201.13@tcp:101: Request processed in 434us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581031.569382:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00010000:00010000:1.0:1788581031.921187:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581032.047497:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581032.047528:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014211712:0@lo:13: 00000100:00100000:1.0:1788581032.047610:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581032.047798:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014211712 00000100:00100000:2.0:1788581032.047806:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014211712 00000100:00100000:2.0:1788581032.047863:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788581032.047872:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014211712:12345-0@lo:13: 00002000:00000024:2.0:1788581032.047895:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581032.047955:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014211712:12345-0@lo:13: Request processed in 84us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581032.047962:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788581032.048023:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190474c3100 x1875463014211712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581032.048063:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014211712:0@lo:13: 00010000:00010000:0.0:1788581032.943495:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581033.968747:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581034.099079:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014211840:0@lo:13: 00000100:00100000:2.0:1788581034.099174:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581034.099640:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014211840 00000100:00100000:1.0:1788581034.099648:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014211840 00000100:00100000:1.0:1788581034.099715:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581034.099726:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014211840:12345-0@lo:13: 00002000:00000024:1.0:1788581034.099762:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581034.099821:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014211840:12345-0@lo:13: Request processed in 97us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581034.099827:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788581034.099923:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919048581f80 x1875463014211840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581034.099952:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014211840:0@lo:13: 00000100:00080000:2.0:1788581034.101731:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581034.127922:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581034.128092:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995315840 00000100:00100000:1.0:1788581034.128103:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995315840 00000100:00100000:1.0:1788581034.128190:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:1.0:1788581034.128201:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:5691:x1875462995315840:12345-192.168.201.13@tcp:41: 00000004:00000024:1.0:1788581034.128269:0:5878:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788581034.128342:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:5691:x1875462995315840:12345-192.168.201.13@tcp:41: Request processed in 143us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581034.128349:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00080000:2.0:1788581034.128426:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581034.133076:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581034.133294:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995315968 00000100:00100000:0.0:1788581034.133304:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995315968 00000100:00100000:0.0:1788581034.133381:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:0.0:1788581034.133391:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:5691:x1875462995315968:12345-192.168.201.13@tcp:13: 00002000:00000024:0.0:1788581034.133416:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581034.133492:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:5691:x1875462995315968:12345-192.168.201.13@tcp:13: Request processed in 102us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581034.133500:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00080000:2.0:1788581034.133648:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581034.138613:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581034.138716:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995316096 00000100:00100000:1.0:1788581034.138727:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995316096 00000100:00100000:1.0:1788581034.138803:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:1.0:1788581034.138814:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:5691:x1875462995316096:12345-192.168.201.13@tcp:13: 00002000:00000024:1.0:1788581034.138873:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581034.138990:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:5691:x1875462995316096:12345-192.168.201.13@tcp:13: Request processed in 177us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581034.138997:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00080000:2.0:1788581034.139332:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788581034.994055:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788581035.217104:0:7696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11f1870a-1d9b-4af2-bb25-e81f8742df75 00000001:00100000:0.0:1788581035.753749:0:6750:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11f1870a-1d9b-4af2-bb25-e81f8742df75 00000001:00100000:0.0:1788581035.762615:0:5899:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 11f1870a-1d9b-4af2-bb25-e81f8742df75 00010000:00010000:2.0:1788581036.017392:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581036.423826:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581036.423880:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581036.424047:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995316480 00000100:00100000:1.0:1788581036.424061:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995316480 00000100:00100000:1.0:1788581036.424146:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:1.0:1788581036.424158:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995316480:12345-192.168.201.13@tcp:400: 00000100:00100000:1.0:1788581036.424302:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995316480:12345-192.168.201.13@tcp:400: Request processed in 145us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581036.424310:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00080000:3.0:1788581036.428116:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581036.428311:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995316224 00000100:00100000:2.0:1788581036.428328:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995316224 00000100:00100000:2.0:1788581036.428446:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 129 00000100:00100000:2.0:1788581036.428459:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2374:x1875462995316224:12345-192.168.201.13@tcp:400: 00000100:00100000:2.0:1788581036.428590:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2374:x1875462995316224:12345-192.168.201.13@tcp:400: Request processed in 133us (4785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581036.428599:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 129 00000100:00100000:3.0:1788581036.438674:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581036.438730:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581036.438795:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995316352 00000100:00100000:0.0:1788581036.438828:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995316352 00000100:00100000:1.0:1788581036.438885:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995316608 00000100:00100000:1.0:1788581036.438890:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995316608 00000100:00100000:1.0:1788581036.438935:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:0.0:1788581036.438935:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:0.0:1788581036.438948:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995316352:12345-192.168.201.13@tcp:400: 00000100:00100000:1.0:1788581036.438953:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995316608:12345-192.168.201.13@tcp:400: 00000100:00100000:0.0:1788581036.439041:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995316352:12345-192.168.201.13@tcp:400: Request processed in 96us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581036.439050:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:1.0:1788581036.439119:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995316608:12345-192.168.201.13@tcp:400: Request processed in 166us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581036.439127:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00080000:3.0:1788581036.439425:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581036.439442:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581036.661753:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014211968:0@lo:400: 00000100:00100000:2.0:1788581036.661881:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581036.661956:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3339:1875463014212480:0@lo:400: 00000100:00100000:2.0:1788581036.661998:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581036.662035:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581036.662041:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014212352:0@lo:400: 00000100:00100000:2.0:1788581036.662070:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581036.662110:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014211968 00000100:00100000:2.0:1788581036.662121:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014211968 00000100:00100000:2.0:1788581036.662189:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788581036.662201:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3339:x1875463014211968:12345-0@lo:400: 00000100:00100000:2.0:1788581036.662301:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3339:x1875463014211968:12345-0@lo:400: Request processed in 101us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581036.662309:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788581036.662351:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014212480 00000100:00100000:2.0:1788581036.662355:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014212480 00000100:00100000:2.0:1788581036.662402:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788581036.662409:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3339:x1875463014212480:12345-0@lo:400: 00000100:00100000:2.0:1788581036.662444:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3339:x1875463014212480:12345-0@lo:400: Request processed in 36us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581036.662451:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788581036.662493:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581036.663478:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014211968:0@lo:400: 00000100:00100000:2.0:1788581036.663511:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3339:1875463014212480:0@lo:400: 00000100:00100000:2.0:1788581036.663599:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014212096:0@lo:400: 00000100:00100000:2.0:1788581036.663793:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581036.663824:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014212608:0@lo:400: 00000100:00100000:2.0:1788581036.663849:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581036.663871:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581036.663877:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014212224:0@lo:400: 00000100:00100000:2.0:1788581036.663898:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581036.663931:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014212096 00000100:00100000:2.0:1788581036.663947:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014212096 00000100:00100000:2.0:1788581036.663980:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014212224 00000100:00100000:2.0:1788581036.663982:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014212224 00000100:00100000:2.0:1788581036.664010:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788581036.664019:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014212096:12345-0@lo:400: 00000100:00100000:2.0:1788581036.664070:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014212096:12345-0@lo:400: Request processed in 53us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581036.664078:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788581036.664094:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788581036.664100:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014212224:12345-0@lo:400: 00000100:00100000:2.0:1788581036.664127:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014212224:12345-0@lo:400: Request processed in 27us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581036.664133:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788581036.664148:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581036.664183:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014212224:0@lo:400: 00000100:00100000:2.0:1788581036.664220:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014212096:0@lo:400: 00000100:00100000:1.0:1788581036.665941:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014212352 00000100:00100000:1.0:1788581036.665958:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014212352 00000100:00100000:1.0:1788581036.666044:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014212608 00000100:00100000:1.0:1788581036.666048:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014212608 00000100:00100000:1.0:1788581036.666070:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581036.666080:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014212352:12345-0@lo:400: 00000100:00100000:1.0:1788581036.666397:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014212352:12345-0@lo:400: Request processed in 318us (4324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581036.666425:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581036.666443:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581036.666450:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014212608:12345-0@lo:400: 00000100:00100000:1.0:1788581036.666489:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014212608:12345-0@lo:400: Request processed in 39us (2638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581036.666495:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788581036.666568:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907fc3e300 x1875463014212608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581036.666584:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014212608:0@lo:400: 00010000:00080000:1.0:1788581036.666853:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907fc3d500 x1875463014212352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581036.666866:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014212352:0@lo:400: 00000100:00080000:0.0:1788581036.667471:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581036.667479:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788581037.039508:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581037.167694:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014212736:0@lo:13: 00000100:00100000:0.0:1788581037.167794:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581037.167902:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014212736 00000100:00100000:0.0:1788581037.167912:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014212736 00000100:00100000:0.0:1788581037.167998:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788581037.168008:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014212736:12345-0@lo:13: 00002000:00000024:0.0:1788581037.168054:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581037.168141:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014212736:12345-0@lo:13: Request processed in 133us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581037.168156:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788581037.168208:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c60d180 x1875463014212736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581037.168231:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014212736:0@lo:13: 00000001:02000400:3.0:1788581037.375069:0:8345:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788581038.065841:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581039.098221:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581039.216378:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581039.216404:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014212864:0@lo:13: 00000100:00100000:3.0:1788581039.216480:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581039.216563:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014212864 00000100:00100000:3.0:1788581039.216571:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014212864 00000100:00100000:3.0:1788581039.216631:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788581039.216642:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014212864:12345-0@lo:13: 00002000:00000024:3.0:1788581039.216677:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788581039.216724:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014212864:12345-0@lo:13: Request processed in 85us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581039.216731:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788581039.216763:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788581039.216800:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c60df80 x1875463014212864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581039.216818:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014212864:0@lo:13: 00010000:00010000:1.0:1788581040.115145:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581041.142162:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788581041.546855:0:8494:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1db9e2e0 20000000:00000080:3.0:1788581041.546874:0:8494:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff919076bf5c00 uarg=0000000000000000 20000000:01000000:3.0:1788581041.546918:0:8494:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788581041.546920:0:8494:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788581041.546923:0:8494:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788581041.546929:0:8494:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788581041.546934:0:8494:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788581041.546949:0:8494:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788581041.546952:0:8494:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788581041.547160:0:8494:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788581041.547164:0:8494:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000100:00100000:0.0:1788581041.548705:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581041.548743:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581041.548778:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581041.548806:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581041.548836:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995316864 00000100:00100000:0.0:1788581041.548864:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995316864 00000100:00100000:0.0:1788581041.548929:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 26 00000100:00100000:0.0:1788581041.548941:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995316864:12345-192.168.201.13@tcp:400: 00000100:00100000:0.0:1788581041.549018:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995316864:12345-192.168.201.13@tcp:400: Request processed in 79us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581041.549026:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 26 00000100:00100000:0.0:1788581041.549068:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995316992 00000100:00100000:0.0:1788581041.549073:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995316992 00000100:00100000:0.0:1788581041.549100:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995317120 00000100:00100000:0.0:1788581041.549103:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995317120 00000100:00100000:0.0:1788581041.549120:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:0.0:1788581041.549127:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995316992:12345-192.168.201.13@tcp:400: 00000100:00100000:0.0:1788581041.549153:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995316992:12345-192.168.201.13@tcp:400: Request processed in 27us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581041.549160:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:0.0:1788581041.549172:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:0.0:1788581041.549179:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995317120:12345-192.168.201.13@tcp:400: 00000100:00100000:0.0:1788581041.549202:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995317120:12345-192.168.201.13@tcp:400: Request processed in 23us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581041.549208:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00080000:0.0:1788581041.549222:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581041.549226:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788581041.549229:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581041.549987:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995316736 00000100:00100000:2.0:1788581041.549994:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995316736 00000100:00100000:2.0:1788581041.550102:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 131 00000100:00100000:2.0:1788581041.550112:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2374:x1875462995316736:12345-192.168.201.13@tcp:400: 00000100:00100000:2.0:1788581041.550200:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2374:x1875462995316736:12345-192.168.201.13@tcp:400: Request processed in 90us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581041.550209:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 131 00000040:00080000:2.0:1788581041.551034:0:8495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788581041.553709:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788581041.553771:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788581041.553806:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788581041.553819:0:8494:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788581041.553822:0:8494:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788581041.555170:0:8496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788581041.555974:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788581041.556057:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788581041.556096:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1788581041.556114:0:8494:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788581041.556117:0:8494:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788581041.557153:0:8497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788581041.557887:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788581041.557956:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788581041.558013:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788581041.558030:0:8494:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788581041.558033:0:8494:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788581041.565773:0:8498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788581041.566728:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788581041.566783:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788581041.566838:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:3.0:1788581041.566926:0:8494:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788581041.566948:0:8494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffb5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.566967:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919040030c00/0xf54e3944c2a6feb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6feab expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.566989:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190821ce000/0xf54e3944c2a6fedc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fed5 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.566996:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190821ce400/0xf54e3944c2a6ff06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6feff expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.567004:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190821cf800/0xf54e3944c2a6ff14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6ff0d expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.567010:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190821ce800/0xf54e3944c2a6ff22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6ff1b expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.567017:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190821cf000/0xf54e3944c2a6ff3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6ff37 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.567023:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6ff68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6ff61 expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.567033:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919044ca8600/0xf54e3944c2a6ff76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8edd expref: 9 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.567114:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919044ca8c00/0xf54e3944c2a6ff7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8ee4 expref: 9 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.567123:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffb5 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.567167:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919044ca8c00/0xf54e3944c2a6ff7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8ee4 expref: 9 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.567197:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919044ca8c00/0xf54e3944c2a6ff7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8ee4 expref: 9 pid: 5870 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581041.567213:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014212992:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581041.567695:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919044ca8600/0xf54e3944c2a6ff76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8edd expref: 9 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.567705:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919044ca8600/0xf54e3944c2a6ff76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8edd expref: 9 pid: 5869 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581041.567714:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014213120:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581041.567743:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6ff68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6ff61 expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.567750:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6ff68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6ff61 expref: 18 pid: 5870 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581041.567758:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014213248:0@lo:104: 00000100:00100000:3.0:1788581041.567808:0:8494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581041.567855:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190821cf000/0xf54e3944c2a6ff3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6ff37 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.567863:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9190821cf000/0xf54e3944c2a6ff3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6ff37 expref: 18 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581041.567870:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c57b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014213376:0@lo:104: 00000100:00100000:3.0:1788581041.567891:0:8494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581041.567930:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190821ce800/0xf54e3944c2a6ff22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6ff1b expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.567938:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9190821ce800/0xf54e3944c2a6ff22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6ff1b expref: 18 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581041.567945:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c56680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014213504:0@lo:104: 00010000:00010000:3.0:1788581041.567969:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190821cf800/0xf54e3944c2a6ff14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6ff0d expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.567976:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9190821cf800/0xf54e3944c2a6ff14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6ff0d expref: 18 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581041.567984:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c54e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014213632:0@lo:104: 00010000:00010000:3.0:1788581041.568006:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190821ce400/0xf54e3944c2a6ff06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6feff expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.568014:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9190821ce400/0xf54e3944c2a6ff06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6feff expref: 18 pid: 5870 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581041.568021:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c57100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014213760:0@lo:104: 00010000:00010000:3.0:1788581041.568118:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190821ce000/0xf54e3944c2a6fedc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6fed5 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.568127:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9190821ce000/0xf54e3944c2a6fedc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6fed5 expref: 18 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581041.568135:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c54380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014213888:0@lo:104: 00010000:00010000:3.0:1788581041.568161:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919040030c00/0xf54e3944c2a6feb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6feab expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.568180:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919040030c00/0xf54e3944c2a6feb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6feab expref: 18 pid: 5870 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581041.568188:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c55180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014214016:0@lo:104: 00000100:00100000:3.0:1788581041.568209:0:8494:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c950780 going to sleep for 11 seconds 00000100:00100000:2.0:1788581041.568299:0:5859:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788581041.568319:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581041.568331:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581041.568339:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581041.568346:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581041.568353:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581041.568361:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014213248 00000100:00100000:2.0:1788581041.568367:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014213248 00000100:00100000:2.0:1788581041.568426:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014213376 00000100:00100000:2.0:1788581041.568430:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014213376 00000100:00100000:2.0:1788581041.568452:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014213504 00000100:00100000:2.0:1788581041.568456:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014213504 00000100:00100000:2.0:1788581041.568465:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014213632 00000100:00100000:2.0:1788581041.568467:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014213632 00000100:00100000:2.0:1788581041.568476:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014213760 00000100:00100000:2.0:1788581041.568478:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014213760 00000100:00100000:2.0:1788581041.568496:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014213888 00000100:00100000:2.0:1788581041.568499:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014213888 00000100:00100000:2.0:1788581041.568510:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014214016 00000100:00100000:2.0:1788581041.568512:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014214016 00000100:00100000:2.0:1788581041.568524:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788581041.568533:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+9:8494:x1875463014213248:12345-0@lo:104: 00010000:00010000:2.0:1788581041.568546:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff9190821cf200/0xf54e3944c2a6ff61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6ff68 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581041.568602:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788581041.568608:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+9:8494:x1875463014213248:12345-0@lo:104: Request processed in 77us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581041.568615:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788581041.568632:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788581041.568638:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906cb4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+8:8494:x1875463014213376:12345-0@lo:104: 00010000:00010000:2.0:1788581041.568645:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff919040031a00/0xf54e3944c2a6ff37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6ff3e expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581041.568676:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788581041.568681:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906cb4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+8:8494:x1875463014213376:12345-0@lo:104: Request processed in 44us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581041.568687:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788581041.568726:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788581041.568732:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+7:8494:x1875463014213504:12345-0@lo:104: 00010000:00010000:2.0:1788581041.568740:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6ff1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6ff22 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581041.568770:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788581041.568775:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+7:8494:x1875463014213504:12345-0@lo:104: Request processed in 44us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581041.568780:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788581041.568790:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788581041.568795:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+6:8494:x1875463014213632:12345-0@lo:104: 00010000:00010000:2.0:1788581041.568803:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6ff0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6ff14 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581041.568824:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788581041.568828:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+6:8494:x1875463014213632:12345-0@lo:104: Request processed in 33us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581041.568833:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788581041.568842:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581041.568846:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+5:8494:x1875463014213760:12345-0@lo:104: 00010000:00010000:2.0:1788581041.568853:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a6feff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6ff06 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581041.568871:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788581041.568875:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+5:8494:x1875463014213760:12345-0@lo:104: Request processed in 29us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581041.568880:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581041.568895:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581041.568900:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+4:8494:x1875463014213888:12345-0@lo:104: 00010000:00010000:2.0:1788581041.568907:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fedc expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581041.568927:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788581041.568931:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+4:8494:x1875463014213888:12345-0@lo:104: Request processed in 32us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581041.568937:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581041.568945:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788581041.568950:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:8494:x1875463014214016:12345-0@lo:104: 00010000:00010000:2.0:1788581041.568956:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff9190821cec00/0xf54e3944c2a6feab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6feb2 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581041.568992:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788581041.568996:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:8494:x1875463014214016:12345-0@lo:104: Request processed in 46us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581041.569002:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788581041.569670:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014213248:0@lo:104: 00000100:00100000:3.0:1788581041.569679:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c57b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014213376:0@lo:104: 00000100:00100000:3.0:1788581041.569687:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c56680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014213504:0@lo:104: 00000100:00100000:3.0:1788581041.569694:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c54e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014213632:0@lo:104: 00000100:00100000:3.0:1788581041.569700:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c57100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014213760:0@lo:104: 00000100:00100000:3.0:1788581041.569705:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c54380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014213888:0@lo:104: 00000100:00100000:3.0:1788581041.569711:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c55180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014214016:0@lo:104: 00010000:00010000:1.0:1788581041.569931:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788581041.569939:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff9190821cf200/0xf54e3944c2a6ff61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6ff68 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.569949:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf200 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:1.0:1788581041.569954:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff9190821cf200/0xf54e3944c2a6ff61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6ff68 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.569962:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff9190821cf200/0xf54e3944c2a6ff61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6ff68 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581041.569969:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff9190821cf200/0xf54e3944c2a6ff61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6ff68 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581041.569986:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581041.570029:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff9190821cf200/0xf54e3944c2a6ff61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6ff68 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570035:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581041.570130:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff9190821cf200/0xf54e3944c2a6ff61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6ff68 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570138:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff9190821cf200/0xf54e3944c2a6ff61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6ff68 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570152:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788581041.570155:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919040031a00/0xf54e3944c2a6ff37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6ff3e expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570160:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040031a00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:1.0:1788581041.570164:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919040031a00/0xf54e3944c2a6ff37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6ff3e expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570171:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919040031a00/0xf54e3944c2a6ff37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6ff3e expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581041.570177:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919040031a00/0xf54e3944c2a6ff37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6ff3e expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581041.570182:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581041.570206:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919040031a00/0xf54e3944c2a6ff37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6ff3e expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570212:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581041.570228:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919040031a00/0xf54e3944c2a6ff37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6ff3e expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570235:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919040031a00/0xf54e3944c2a6ff37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6ff3e expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570270:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788581041.570273:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6ff1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6ff22 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570279:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8e00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:1.0:1788581041.570282:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6ff1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6ff22 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570289:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6ff1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6ff22 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581041.570295:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6ff1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6ff22 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581041.570300:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581041.570312:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6ff1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6ff22 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570317:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581041.570322:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6ff1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6ff22 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570328:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a6ff1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6ff22 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570335:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788581041.570343:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6ff0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6ff14 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570348:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf400 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:1.0:1788581041.570351:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6ff0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6ff14 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570358:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6ff0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6ff14 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581041.570364:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6ff0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6ff14 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581041.570369:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581041.570454:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6ff0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6ff14 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570460:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581041.570465:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6ff0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6ff14 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570471:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff9190821cf400/0xf54e3944c2a6ff0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6ff14 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570480:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788581041.570483:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a6feff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6ff06 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570553:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040031600 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:1.0:1788581041.570556:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a6feff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6ff06 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570573:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a6feff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6ff06 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581041.570580:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a6feff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6ff06 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581041.570586:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581041.570598:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a6feff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6ff06 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570603:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581041.570607:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a6feff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6ff06 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570613:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a6feff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6ff06 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570622:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581041.570625:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fedc expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570631:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b3a00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:1.0:1788581041.570633:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6fedc expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570640:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6fedc expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581041.570646:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6fedc expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581041.570655:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581041.570664:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fed5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fedc expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570670:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581041.570673:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fed5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fedc expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570680:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fed5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fedc expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570688:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581041.570691:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff9190821cec00/0xf54e3944c2a6feab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6feb2 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570696:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cec00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:1.0:1788581041.570699:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff9190821cec00/0xf54e3944c2a6feab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6feb2 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570705:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff9190821cec00/0xf54e3944c2a6feab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6feb2 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581041.570712:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff9190821cec00/0xf54e3944c2a6feab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6feb2 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581041.570717:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581041.570724:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff9190821cec00/0xf54e3944c2a6feab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6feb2 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570729:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581041.570735:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff9190821cec00/0xf54e3944c2a6feab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6feb2 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570742:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff9190821cec00/0xf54e3944c2a6feab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6feb2 expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.570755:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581041.570757:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581041.570759:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581041.570767:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581041.570771:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581041.570784:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014214528:0@lo:103: 00000100:00100000:1.0:1788581041.570836:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581041.571000:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788581041.571006:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014214144:0@lo:103: 00000100:00100000:1.0:1788581041.571027:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581041.571198:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014214656:0@lo:103: 00000100:00100000:1.0:1788581041.571217:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581041.572276:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014214400:0@lo:103: 00000100:00100000:0.0:1788581041.572327:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014214272:0@lo:103: 00000100:00100000:3.0:1788581041.574879:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581041.574937:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014214528 00000100:00100000:2.0:1788581041.574946:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014214528 00000100:00100000:0.0:1788581041.575142:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014214144 00000100:00100000:0.0:1788581041.575160:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014214144 00010000:00010000:0.0:1788581041.575196:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6ff68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6ff61 expref: 20 pid: 5870 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581041.575350:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014214656 00000100:00100000:0.0:1788581041.575355:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014214656 00010000:00010000:0.0:1788581041.575370:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190821ce400/0xf54e3944c2a6ff06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6feff expref: 21 pid: 5870 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581041.575802:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014214784:0@lo:103: 00000100:00100000:3.0:1788581041.575873:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581041.577730:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014214272 00000100:00100000:1.0:1788581041.577744:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014214272 00010000:00010000:1.0:1788581041.577785:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190821cf000/0xf54e3944c2a6ff3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6ff37 expref: 22 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581041.577820:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581041.577830:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+22:3338:x1875463014214144:12345-0@lo:103: 00010000:00010000:1.0:1788581041.577845:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788581041.577948:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788581041.577959:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+22:3338:x1875463014214656:12345-0@lo:103: 00010000:00010000:0.0:1788581041.577968:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581041.577974:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190821ce400/0xf54e3944c2a6ff06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6feff expref: 22 pid: 5870 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.577985:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190821ce400/0xf54e3944c2a6ff06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6feff expref: 22 pid: 5870 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.578002:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190821ce400/0xf54e3944c2a6ff06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6feff expref: 22 pid: 5870 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.578020:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581041.578117:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+21:3338:x1875463014214656:12345-0@lo:103: Request processed in 161us (6897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581041.578125:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788581041.578146:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788581041.578153:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+20:3340:x1875463014214272:12345-0@lo:103: 00010000:00010000:0.0:1788581041.578160:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581041.578165:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190821cf000/0xf54e3944c2a6ff3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6ff37 expref: 20 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.578191:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190821cf000/0xf54e3944c2a6ff3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6ff37 expref: 20 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.578202:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190821cf000/0xf54e3944c2a6ff3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6ff37 expref: 20 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.578212:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581041.578258:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014214272:12345-0@lo:103: Request processed in 89us (3371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581041.578265:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788581041.578801:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014214272:0@lo:103: 00010000:00010000:1.0:1788581041.578962:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6ff68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6ff61 expref: 18 pid: 5870 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.578984:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6ff68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6ff61 expref: 18 pid: 5870 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.578994:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a6ff68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6ff61 expref: 18 pid: 5870 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.579003:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581041.579034:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:3338:x1875463014214144:12345-0@lo:103: Request processed in 1207us (8006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581041.579053:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581041.579068:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014214784 00000100:00100000:1.0:1788581041.579073:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014214784 00010000:00010000:1.0:1788581041.579090:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190821ce000/0xf54e3944c2a6fedc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fed5 expref: 17 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581041.579105:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788581041.579111:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:3340:x1875463014214784:12345-0@lo:103: 00010000:00010000:1.0:1788581041.579119:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581041.579124:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190821ce000/0xf54e3944c2a6fedc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fed5 expref: 17 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.579131:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190821ce000/0xf54e3944c2a6fedc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6fed5 expref: 17 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.579139:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190821ce000/0xf54e3944c2a6fedc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6fed5 expref: 17 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.579148:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581041.579180:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:3340:x1875463014214784:12345-0@lo:103: Request processed in 69us (3307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581041.579193:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788581041.579217:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581041.579271:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014214912:0@lo:103: 00000100:00100000:1.0:1788581041.579304:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581041.579335:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014214144:0@lo:103: 00000100:00100000:1.0:1788581041.579345:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014214656:0@lo:103: 00000100:00100000:1.0:1788581041.580011:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014214784:0@lo:103: 00000100:00100000:1.0:1788581041.580061:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014214400 00000100:00100000:1.0:1788581041.580066:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014214400 00010000:00010000:1.0:1788581041.580087:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190821ce800/0xf54e3944c2a6ff22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6ff1b expref: 16 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581041.580102:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014214912 00000100:00100000:1.0:1788581041.580105:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014214912 00010000:00010000:1.0:1788581041.580115:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919040030c00/0xf54e3944c2a6feb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6feab expref: 17 pid: 5870 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581041.580128:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788581041.580134:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:3341:x1875463014214400:12345-0@lo:103: 00010000:00010000:1.0:1788581041.580144:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581041.580149:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190821ce800/0xf54e3944c2a6ff22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6ff1b expref: 17 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.580158:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190821ce800/0xf54e3944c2a6ff22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6ff1b expref: 17 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.580168:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190821ce800/0xf54e3944c2a6ff22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6ff1b expref: 17 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.580189:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581041.580232:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:3341:x1875463014214400:12345-0@lo:103: Request processed in 98us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581041.580238:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788581041.580274:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788581041.580281:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:3341:x1875463014214912:12345-0@lo:103: 00010000:00010000:1.0:1788581041.580288:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581041.580292:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919040030c00/0xf54e3944c2a6feb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6feab expref: 15 pid: 5870 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.580300:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919040030c00/0xf54e3944c2a6feb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6feab expref: 15 pid: 5870 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.580309:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919040030c00/0xf54e3944c2a6feb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6feab expref: 15 pid: 5870 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581041.580318:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581041.580341:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:3341:x1875463014214912:12345-0@lo:103: Request processed in 61us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581041.580347:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788581041.580631:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014214400:0@lo:103: 00010000:00010000:2.0:1788581041.581430:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190821cf800/0xf54e3944c2a6ff14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6ff0d expref: 13 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581041.581483:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788581041.581673:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076315c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:3338:x1875463014214528:12345-0@lo:103: 00010000:00010000:2.0:1788581041.581685:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581041.581691:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190821cf800/0xf54e3944c2a6ff14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6ff0d expref: 13 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581041.581717:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190821cf800/0xf54e3944c2a6ff14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6ff0d expref: 13 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581041.581733:0:6739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190821cf800/0xf54e3944c2a6ff14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6ff0d expref: 13 pid: 5871 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581041.581747:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581041.582715:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581041.582738:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581041.582759:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995317376 00000100:00100000:0.0:1788581041.582766:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995317376 00010000:00010000:0.0:1788581041.582790:0:5862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919044ca8600/0xf54e3944c2a6ff76 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8edd expref: 10 pid: 5869 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581041.582807:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995317248 00000100:00100000:0.0:1788581041.582810:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995317248 00010000:00010000:0.0:1788581041.582818:0:5862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919044ca8c00/0xf54e3944c2a6ff7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8ee4 expref: 11 pid: 5870 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581041.582829:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:0.0:1788581041.582836:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+11:2375:x1875462995317376:12345-192.168.201.13@tcp:103: 00010000:00010000:0.0:1788581041.582856:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581041.582861:0:5862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919044ca8600/0xf54e3944c2a6ff76 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8edd expref: 11 pid: 5869 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.582883:0:5862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919044ca8600/0xf54e3944c2a6ff76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8edd expref: 11 pid: 5869 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.582896:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581041.582935:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+11:2375:x1875462995317376:12345-192.168.201.13@tcp:103: Request processed in 99us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581041.582942:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:0.0:1788581041.582959:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:0.0:1788581041.582966:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2375:x1875462995317248:12345-192.168.201.13@tcp:103: 00010000:00010000:0.0:1788581041.582976:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581041.582980:0:5862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919044ca8c00/0xf54e3944c2a6ff7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8ee4 expref: 10 pid: 5870 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.582989:0:5862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919044ca8c00/0xf54e3944c2a6ff7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8ee4 expref: 10 pid: 5870 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.583000:0:5862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffb5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.583009:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffb5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.583022:0:5862:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffb5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.583029:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffb5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.583035:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffb5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.583060:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffb5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.583066:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b2a00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581041.583070:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffb5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.583080:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffb5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.583089:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffb5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581041.583099:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581041.583118:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2375:x1875462995317248:12345-192.168.201.13@tcp:103: Request processed in 152us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581041.583123:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 20 00010000:00010000:3.0:1788581041.583829:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919044ca8c00/0xf54e3944c2a6ff7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8ee4 expref: 9 pid: 5870 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581041.583856:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014212992:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581041.583870:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919044ca8600/0xf54e3944c2a6ff76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8edd expref: 8 pid: 5869 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581041.583878:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875463014213120:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581041.583937:0:8494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffb5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.583947:0:8494:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffb5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.583953:0:8494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffb5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581041.583960:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffb5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581041.585661:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014214912:0@lo:103: 00000100:00100000:3.0:1788581041.591405:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076315c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:3338:x1875463014214528:12345-0@lo:103: Request processed in 9725us (20556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581041.591421:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788581041.591552:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014214528:0@lo:103: 00000100:00100000:3.0:1788581041.775582:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3339:1875463014215168:0@lo:400: 00000100:00100000:3.0:1788581041.775655:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581041.775704:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014215680:0@lo:400: 00000100:00100000:3.0:1788581041.775729:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581041.775756:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788581041.775762:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014215040:0@lo:400: 00000100:00100000:3.0:1788581041.775786:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581041.775807:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3339:1875463014215552:0@lo:400: 00000100:00100000:3.0:1788581041.775827:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581041.775849:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014215296:0@lo:400: 00000100:00100000:3.0:1788581041.775869:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581041.775884:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581041.775889:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014215424:0@lo:400: 00000100:00100000:3.0:1788581041.775921:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581041.776074:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014215168 00000100:00100000:0.0:1788581041.776087:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014215168 00000100:00100000:0.0:1788581041.776124:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014215552 00000100:00100000:0.0:1788581041.776127:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014215552 00000100:00100000:0.0:1788581041.776158:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014215296 00000100:00100000:0.0:1788581041.776162:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014215296 00000100:00100000:0.0:1788581041.776177:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788581041.776186:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3339:x1875463014215168:12345-0@lo:400: 00000100:00100000:0.0:1788581041.776280:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3339:x1875463014215168:12345-0@lo:400: Request processed in 94us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581041.776287:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788581041.776306:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788581041.776319:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3339:x1875463014215552:12345-0@lo:400: 00000100:00100000:0.0:1788581041.776363:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3339:x1875463014215552:12345-0@lo:400: Request processed in 45us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581041.776369:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788581041.776381:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788581041.776387:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014215296:12345-0@lo:400: 00000100:00100000:0.0:1788581041.776420:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014215296:12345-0@lo:400: Request processed in 33us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581041.776425:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788581041.776461:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014215680 00000100:00100000:0.0:1788581041.776465:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014215680 00000100:00100000:0.0:1788581041.776489:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014215424 00000100:00100000:0.0:1788581041.776493:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014215424 00000100:00100000:0.0:1788581041.776507:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788581041.776513:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014215680:12345-0@lo:400: 00000100:00100000:0.0:1788581041.776544:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014215680:12345-0@lo:400: Request processed in 31us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581041.776550:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788581041.776561:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788581041.776566:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014215424:12345-0@lo:400: 00000100:00100000:0.0:1788581041.776596:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014215424:12345-0@lo:400: Request processed in 31us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581041.776602:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788581041.776644:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919049c54380 x1875463014215424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581041.776657:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014215424:0@lo:400: 00000100:00100000:0.0:1788581041.776682:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014215296:0@lo:400: 00000100:00100000:0.0:1788581041.776713:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3339:1875463014215552:0@lo:400: 00000100:00100000:0.0:1788581041.776723:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3339:1875463014215168:0@lo:400: 00010000:00080000:0.0:1788581041.776732:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919049c54e00 x1875463014215680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581041.776740:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014215680:0@lo:400: 00000100:00080000:3.0:1788581041.776949:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581041.776953:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581041.776955:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581041.779755:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014215040 00000100:00100000:2.0:1788581041.779768:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014215040 00000100:00100000:2.0:1788581041.779814:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788581041.779822:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:3339:x1875463014215040:12345-0@lo:400: 00000100:00100000:2.0:1788581041.779906:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:3339:x1875463014215040:12345-0@lo:400: Request processed in 85us (4118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581041.779913:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788581041.783615:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014215040:0@lo:400: 00010000:00010000:1.0:1788581042.159854:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581042.287572:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014215808:0@lo:13: 00000100:00100000:0.0:1788581042.287661:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581042.287796:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014215808 00000100:00100000:3.0:1788581042.287803:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014215808 00000100:00100000:3.0:1788581042.287849:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788581042.287858:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014215808:12345-0@lo:13: 00002000:00000024:3.0:1788581042.287893:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788581042.287943:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014215808:12345-0@lo:13: Request processed in 84us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581042.287950:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788581042.288148:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919049c54700 x1875463014215808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581042.288166:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014215808:0@lo:13: 10000000:01000000:2.0:1788581042.672342:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788581042.672350:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91907f8f1000 from 39 10000000:01000000:2.0:1788581042.672356:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788581042.672408:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb83600/0xf54e3944c2a6ffbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.672435:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91907bb83600/0xf54e3944c2a6ffbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.672446:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91907bb83600/0xf54e3944c2a6ffbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581042.672471:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014215936:0@lo:101: 00000100:00100000:2.0:1788581042.672542:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581042.672630:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047d4acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581042.672690:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014215936 00000100:00100000:0.0:1788581042.672699:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014215936 00000100:00100000:0.0:1788581042.672750:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788581042.672759:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+12:5874:x1875463014215936:12345-0@lo:101: 00010000:00010000:0.0:1788581042.672773:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581042.672785:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919040031e00/0xf54e3944c2a6ffc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6ffbc expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581042.672809:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919040031e00/0xf54e3944c2a6ffc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6ffbc expref: 13 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581042.672819:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919040031e00/0xf54e3944c2a6ffc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6ffbc expref: 13 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581042.672839:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919040031e00, rc 0) 00000100:00100000:0.0:1788581042.672896:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:5874:x1875463014215936:12345-0@lo:101: Request processed in 138us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581042.672902:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788581042.673005:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014215936:0@lo:101: 00010000:00010000:1.0:1788581042.673030:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91907bb83600/0xf54e3944c2a6ffbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ffc3 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581042.673039:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91907bb83600/0xf54e3944c2a6ffbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6ffc3 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581042.673088:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076314a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014216064:0@lo:501: 00000100:00100000:1.0:1788581042.673114:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581042.673134:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05900 going to sleep for 11 seconds 00000100:00100000:2.0:1788581042.673301:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014216064 00000100:00100000:2.0:1788581042.673305:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014216064 00000100:00100000:2.0:1788581042.673340:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788581042.673348:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:5874:x1875463014216064:12345-0@lo:501: 00000100:00100000:2.0:1788581042.673593:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:5874:x1875463014216064:12345-0@lo:501: Request processed in 246us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581042.673600:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788581042.674291:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076314a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014216064:0@lo:501: 00000100:00100000:1.0:1788581042.674337:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076314a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014216192:0@lo:503: 00000100:00100000:1.0:1788581042.674378:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581042.674426:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05900 going to sleep for 11 seconds 00000100:00100000:3.0:1788581042.674488:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014216192 00000100:00100000:3.0:1788581042.674493:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014216192 00000100:00100000:3.0:1788581042.674532:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788581042.674540:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:5874:x1875463014216192:12345-0@lo:503: 00000100:00100000:3.0:1788581042.674695:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:5874:x1875463014216192:12345-0@lo:503: Request processed in 155us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581042.674702:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788581042.675118:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076314a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014216192:0@lo:503: 00000100:00100000:1.0:1788581042.677269:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076314a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8511:1875463014216320:0@lo:502: 00000100:00100000:1.0:1788581042.677353:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581042.677406:0:8511:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581042.678132:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014216320 00000100:00100000:0.0:1788581042.678142:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014216320 00000100:00100000:0.0:1788581042.678199:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788581042.678209:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:8511:x1875463014216320:12345-0@lo:502: 00000100:00100000:0.0:1788581042.678521:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:8511:x1875463014216320:12345-0@lo:502: Request processed in 313us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581042.678530:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788581042.679598:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076314a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8511:1875463014216320:0@lo:502: 00000100:00100000:1.0:1788581042.679671:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076314a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8511:1875463014216448:0@lo:502: 00000100:00100000:1.0:1788581042.679725:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581042.679763:0:8511:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05180 going to sleep for 11 seconds 00000100:00100000:3.0:1788581042.680588:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014216448 00000100:00100000:3.0:1788581042.680597:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014216448 00000100:00100000:3.0:1788581042.680656:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788581042.680666:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:8511:x1875463014216448:12345-0@lo:502: 00000100:00100000:3.0:1788581042.680908:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:8511:x1875463014216448:12345-0@lo:502: Request processed in 244us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581042.680916:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788581042.682343:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076314a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8511:1875463014216448:0@lo:502: 00000040:00080000:1.0:1788581042.682388:0:8511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788581042.683152:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788581042.683173:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788581042.683183:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb83600/0xf54e3944c2a6ffbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ffc3 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.683193:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91907bb83600/0xf54e3944c2a6ffbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ffc3 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581042.683202:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788581042.683205:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788581042.683207:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788581042.683279:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb83c00/0xf54e3944c2a6ffca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.683288:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91907bb83c00/0xf54e3944c2a6ffca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.683297:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91907bb83c00/0xf54e3944c2a6ffca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581042.683330:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014216576:0@lo:101: 00000100:00100000:2.0:1788581042.683391:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581042.683457:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047d4ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581042.683609:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014216576 00000100:00100000:3.0:1788581042.683617:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014216576 00000100:00100000:3.0:1788581042.683672:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788581042.683681:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+13:5874:x1875463014216576:12345-0@lo:101: 00010000:00010000:3.0:1788581042.683692:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581042.683704:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6ffca expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581042.683725:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6ffca expref: 14 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581042.683735:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6ffca expref: 14 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581042.683744:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190414b2a00, rc 0) 00000100:00100000:3.0:1788581042.683785:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:5874:x1875463014216576:12345-0@lo:101: Request processed in 105us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581042.683791:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788581042.683874:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014216576:0@lo:101: 00010000:00010000:1.0:1788581042.683893:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91907bb83c00/0xf54e3944c2a6ffca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ffd1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581042.683902:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91907bb83c00/0xf54e3944c2a6ffca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6ffd1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581042.683947:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076314a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014216704:0@lo:501: 00000100:00100000:1.0:1788581042.683984:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581042.684008:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05180 going to sleep for 11 seconds 00000100:00100000:3.0:1788581042.684933:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014216704 00000100:00100000:3.0:1788581042.684941:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014216704 00000100:00100000:3.0:1788581042.684993:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788581042.685002:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:5874:x1875463014216704:12345-0@lo:501: 00000100:00100000:3.0:1788581042.685480:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:5874:x1875463014216704:12345-0@lo:501: Request processed in 478us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581042.685488:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788581042.685601:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076314a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014216704:0@lo:501: 00000100:00100000:1.0:1788581042.685640:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076314a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014216832:0@lo:503: 00000100:00100000:1.0:1788581042.685683:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581042.685706:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05180 going to sleep for 11 seconds 00000100:00100000:2.0:1788581042.685809:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014216832 00000100:00100000:2.0:1788581042.685814:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014216832 00000100:00100000:2.0:1788581042.685848:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788581042.685856:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:5874:x1875463014216832:12345-0@lo:503: 00000100:00100000:2.0:1788581042.686127:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:5874:x1875463014216832:12345-0@lo:503: Request processed in 155us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581042.686137:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788581042.686179:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076314a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014216832:0@lo:503: 00000100:00100000:2.0:1788581042.686452:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8512:1875463014216960:0@lo:502: 00000100:00100000:2.0:1788581042.686491:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581042.686516:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014216960 00000100:00100000:2.0:1788581042.686520:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014216960 00000100:00100000:2.0:1788581042.686539:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788581042.686546:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:8512:x1875463014216960:12345-0@lo:502: 00000100:00100000:2.0:1788581042.686663:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:8512:x1875463014216960:12345-0@lo:502: Request processed in 117us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581042.686670:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788581042.686695:0:8512:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047d4ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581042.686707:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8512:1875463014216960:0@lo:502: 00000020:01000000:2.0:1788581042.686728:0:8512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581042.686737:0:8512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581042.686740:0:8512:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788581042.686745:0:8512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788581042.686763:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8512:1875463014217088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581042.686793:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581042.686810:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014217088 00000100:00100000:2.0:1788581042.686819:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014217088 00000100:00100000:2.0:1788581042.686836:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788581042.686842:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:8512:x1875463014217088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581042.686939:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:8512:x1875463014217088:12345-0@lo:502:llog_process_th.0 Request processed in 96us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581042.686946:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788581042.686983:0:8512:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047d4ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581042.686995:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8512:1875463014217088:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788581042.691706:0:8512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581042.691725:0:8512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581042.691728:0:8512:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788581042.691737:0:8512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788581042.692041:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788581042.692062:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788581042.692072:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb83c00/0xf54e3944c2a6ffca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ffd1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581042.692084:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91907bb83c00/0xf54e3944c2a6ffca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ffd1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581042.692107:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788581042.692109:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91906c6c6000 from 39 10000000:01000000:3.0:1788581042.692112:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788581042.692148:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581042.692157:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581042.692167:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581042.692191:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014217216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581042.692286:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581042.692333:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c9509c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581042.692546:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014217216 00000100:00100000:2.0:1788581042.692554:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014217216 00000100:00100000:2.0:1788581042.692652:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788581042.692662:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:5874:x1875463014217216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581042.692675:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581042.692687:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91907bb83e00/0xf54e3944c2a6ffdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6ffd8 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.692708:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91907bb83e00/0xf54e3944c2a6ffdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6ffd8 expref: 15 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.692718:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91907bb83e00/0xf54e3944c2a6ffdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6ffd8 expref: 15 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.692726:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb83e00, rc 0) 00000100:00100000:2.0:1788581042.692771:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014217216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581042.692784:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788581042.692855:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014217216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581042.692868:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ffdf expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581042.692877:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6ffdf expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581042.692927:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014217344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581042.692952:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581042.707388:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c9509c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581042.707665:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014217344 00000100:00100000:1.0:1788581042.707675:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014217344 00000100:00100000:1.0:1788581042.707762:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788581042.707771:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014217344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581042.708600:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014217344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 826us (15643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581042.708609:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788581042.714465:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014217344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581042.714534:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014217472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581042.714623:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581042.714712:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c9509c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581042.732451:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014217472 00000100:00100000:2.0:1788581042.732467:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014217472 00000100:00100000:1.0:1788581042.733388:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788581042.733401:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014217472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581042.733668:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014217472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 269us (19044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581042.733676:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788581042.733946:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014217472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581042.742473:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8513:1875463014217600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581042.742575:0:8513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581042.742679:0:8513:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581042.746121:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014217600 00000100:00100000:0.0:1788581042.746138:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014217600 00000100:00100000:0.0:1788581042.746287:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788581042.746299:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:8513:x1875463014217600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581042.746654:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:8513:x1875463014217600:12345-0@lo:502:llog_process_th.0 Request processed in 356us (4078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581042.746663:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788581042.748665:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076315500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8513:1875463014217600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581042.748762:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c55500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8513:1875463014217728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581042.748836:0:8513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581042.754284:0:8513:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c950540 going to sleep for 11 seconds 00000100:00100000:1.0:1788581042.758525:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014217728 00000100:00100000:1.0:1788581042.758543:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014217728 00000100:00100000:1.0:1788581042.758624:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788581042.758636:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:8513:x1875463014217728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581042.759110:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:8513:x1875463014217728:12345-0@lo:502:llog_process_th.0 Request processed in 475us (10273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581042.759118:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788581042.761892:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c55500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8513:1875463014217728:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788581042.761946:0:8513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788581042.762319:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788581042.762341:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788581042.762353:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ffdf expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581042.762364:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ffdf expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581042.762391:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788581042.762393:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788581042.762396:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788581042.762441:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581042.762449:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581042.762457:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581042.762478:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014217856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581042.762536:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581042.762595:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91905c77f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788581042.762752:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014217856 00000100:00100000:3.0:1788581042.762760:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014217856 00000100:00100000:3.0:1788581042.762808:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788581042.762818:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:5874:x1875463014217856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581042.762830:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581042.762841:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190414b3800/0xf54e3944c2a6ffed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6ffe6 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581042.762864:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190414b3800/0xf54e3944c2a6ffed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6ffe6 expref: 16 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581042.762875:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190414b3800/0xf54e3944c2a6ffed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6ffe6 expref: 16 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581042.762885:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190414b3800, rc 0) 00000100:00100000:3.0:1788581042.763780:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014217856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 960us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581042.763790:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788581042.768759:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014217856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581042.768795:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ffed expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581042.768810:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6ffed expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581042.769337:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014217984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581042.769408:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581042.769467:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91905c77fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581042.769596:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014217984 00000100:00100000:3.0:1788581042.769616:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014217984 00000100:00100000:3.0:1788581042.769669:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788581042.769679:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014217984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581042.769950:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014217984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581042.769957:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788581042.770156:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014217984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581042.770192:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014218112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581042.770271:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581042.770298:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91905c77fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581042.770526:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014218112 00000100:00100000:1.0:1788581042.770531:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014218112 00000100:00100000:1.0:1788581042.770999:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788581042.773498:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014218112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581042.773796:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014218112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2787us (3523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581042.773806:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788581042.773939:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014218112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581042.774157:0:8514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8514:1875463014218240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581042.774199:0:8514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581042.779036:0:8514:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047d4acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581042.779122:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014218240 00000100:00100000:3.0:1788581042.779133:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014218240 00000100:00100000:3.0:1788581042.779187:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788581042.779196:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:8514:x1875463014218240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581042.779488:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:8514:x1875463014218240:12345-0@lo:502:llog_process_th.0 Request processed in 292us (5287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581042.779496:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788581042.779610:0:8514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8514:1875463014218240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788581042.779645:0:8514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581042.779655:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581042.779658:0:8514:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788581042.779664:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788581042.779700:0:8514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8514:1875463014218368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581042.779744:0:8514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581042.779776:0:8514:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047d4acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581042.779829:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014218368 00000100:00100000:3.0:1788581042.779834:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014218368 00000100:00100000:3.0:1788581042.779855:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788581042.779861:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:8514:x1875463014218368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581042.779981:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:8514:x1875463014218368:12345-0@lo:502:llog_process_th.0 Request processed in 119us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581042.779988:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788581042.780061:0:8514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8514:1875463014218368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788581042.780078:0:8514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581042.780082:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581042.780084:0:8514:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788581042.780088:0:8514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788581042.780238:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788581042.780292:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788581042.780301:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ffed expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581042.780312:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ffed expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581042.780330:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788581042.780333:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91904733b800 from 39 10000000:01000000:3.0:1788581042.780336:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788581042.780359:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581042.780367:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581042.780377:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581042.780391:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014218496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581042.780430:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581042.780449:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c9509c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581042.780505:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014218496 00000100:00100000:2.0:1788581042.780509:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014218496 00000100:00100000:2.0:1788581042.780530:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788581042.780536:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014218496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581042.780545:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581042.780565:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91907bb82800/0xf54e3944c2a6fffb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a6fff4 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.780588:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91907bb82800/0xf54e3944c2a6fffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a6fff4 expref: 17 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.780599:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91907bb82800/0xf54e3944c2a6fffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fff4 expref: 17 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.780608:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb82800, rc 0) 00000100:00100000:2.0:1788581042.780645:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014218496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581042.780651:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788581042.782868:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014218496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581042.782897:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fffb expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581042.782908:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fffb expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581042.782996:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014218624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581042.783051:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581042.783094:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c9509c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581042.783174:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014218624 00000100:00100000:2.0:1788581042.783182:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014218624 00000100:00100000:2.0:1788581042.783222:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788581042.783233:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014218624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581042.783544:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014218624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581042.783551:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788581042.783647:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014218624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581042.783679:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014218752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581042.783723:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581042.783751:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c9509c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581042.783794:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014218752 00000100:00100000:2.0:1788581042.783798:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014218752 00000100:00100000:2.0:1788581042.783817:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788581042.783824:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014218752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581042.783968:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014218752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581042.783976:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788581042.785537:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014218752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581042.785972:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c55500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8515:1875463014218880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581042.786044:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581042.786088:0:8515:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c950c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581042.786134:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014218880 00000100:00100000:2.0:1788581042.786147:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014218880 00000100:00100000:2.0:1788581042.786190:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788581042.786198:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:8515:x1875463014218880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581042.786475:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:8515:x1875463014218880:12345-0@lo:502:llog_process_th.0 Request processed in 276us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581042.786483:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788581042.786624:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c55500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8515:1875463014218880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581042.786667:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919049c55500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8515:1875463014219008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581042.786699:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581042.786725:0:8515:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c950c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581042.786794:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014219008 00000100:00100000:2.0:1788581042.786799:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014219008 00000100:00100000:2.0:1788581042.786827:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788581042.786834:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:8515:x1875463014219008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581042.786967:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:8515:x1875463014219008:12345-0@lo:502:llog_process_th.0 Request processed in 133us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581042.786975:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788581042.787065:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919049c55500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8515:1875463014219008:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788581042.787083:0:8515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788581042.787217:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788581042.787236:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788581042.787269:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fffb expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.787279:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fffb expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581042.787289:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788581042.787291:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788581042.787295:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788581042.787319:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.787327:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.787342:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581042.787355:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014219136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788581042.787380:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581042.787398:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907fc160c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581042.787461:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014219136 00000100:00100000:3.0:1788581042.787465:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014219136 00000100:00100000:3.0:1788581042.787488:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788581042.787495:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014219136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581042.787503:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581042.787514:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190414b2e00/0xf54e3944c2a70009 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a70002 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581042.787534:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190414b2e00/0xf54e3944c2a70009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a70002 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581042.787544:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190414b2e00/0xf54e3944c2a70009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a70002 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581042.787564:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190414b2e00, rc 0) 00000100:00100000:3.0:1788581042.787602:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014219136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581042.787608:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788581042.787711:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014219136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581042.787722:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70009 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.787730:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a70009 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581042.787768:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014219264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581042.787789:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581042.787844:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907fc160c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581042.791905:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014219264 00000100:00100000:0.0:1788581042.791921:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014219264 00000100:00100000:3.0:1788581042.792167:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788581042.792181:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014219264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581042.792505:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014219264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (4713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581042.792512:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788581042.792611:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014219264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581042.792675:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014219392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581042.792725:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581042.792782:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91905c77f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788581042.792846:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014219392 00000100:00100000:1.0:1788581042.792851:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014219392 00000100:00100000:1.0:1788581042.792882:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788581042.792889:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014219392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581042.793026:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014219392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581042.793033:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788581042.793106:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014219392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581042.793457:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8516:1875463014219520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581042.793495:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581042.793530:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff91905c77fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581042.793574:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014219520 00000100:00100000:1.0:1788581042.793578:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014219520 00000100:00100000:1.0:1788581042.793595:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788581042.793601:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:8516:x1875463014219520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581042.793743:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:8516:x1875463014219520:12345-0@lo:502:llog_process_th.0 Request processed in 141us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581042.793750:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788581042.793861:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8516:1875463014219520:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581042.793880:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581042.793888:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581042.793890:0:8516:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788581042.793896:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788581042.793912:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8516:1875463014219648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581042.793939:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581042.793960:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff91905c77fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581042.794001:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014219648 00000100:00100000:1.0:1788581042.794006:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014219648 00000100:00100000:1.0:1788581042.794023:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788581042.794029:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:8516:x1875463014219648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581042.794155:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:8516:x1875463014219648:12345-0@lo:502:llog_process_th.0 Request processed in 124us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581042.794163:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788581042.794378:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8516:1875463014219648:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581042.794398:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581042.794402:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581042.794404:0:8516:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788581042.794408:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788581042.794559:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788581042.794581:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788581042.794592:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70009 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581042.794602:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70009 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581042.794612:0:5874:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788581042.794615:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff919047dccd28 from 1 10000000:01000000:1.0:1788581042.794624:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788581042.794649:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca8800/0xf54e3944c2a70010 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581042.794658:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919044ca8800/0xf54e3944c2a70010 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581042.794667:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919044ca8800/0xf54e3944c2a70010 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581042.794680:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076315f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014219776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788581042.794706:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581042.794734:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581042.794777:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014219776 00000100:00100000:2.0:1788581042.794781:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014219776 00000100:00100000:2.0:1788581042.794812:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788581042.794819:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014219776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581042.794827:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581042.794839:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91907bb82600/0xf54e3944c2a70017 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a70010 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.794860:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91907bb82600/0xf54e3944c2a70017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a70010 expref: 19 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.794882:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91907bb82600/0xf54e3944c2a70017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a70010 expref: 19 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581042.794891:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb82600, rc 0) 00000100:00100000:2.0:1788581042.794926:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014219776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581042.794932:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788581042.794992:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076315f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014219776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581042.795004:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919044ca8800/0xf54e3944c2a70010 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70017 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581042.795013:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919044ca8800/0xf54e3944c2a70010 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a70017 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581042.795056:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076315f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014219904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581042.795079:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581042.795101:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05480 going to sleep for 11 seconds 00000100:00100000:0.0:1788581042.795145:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014219904 00000100:00100000:0.0:1788581042.795150:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014219904 00000100:00100000:0.0:1788581042.795181:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788581042.795188:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014219904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581042.795404:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014219904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (324us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788581042.795426:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788581042.795559:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076315f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014219904:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788581042.795579:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788581042.795585:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca8800/0xf54e3944c2a70010 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70017 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581042.795604:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919044ca8800/0xf54e3944c2a70010 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70017 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581043.186001:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581043.784509:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581043.784617:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995317504 00000100:00100000:2.0:1788581043.784628:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995317504 00000100:00100000:2.0:1788581043.784691:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 165 00000100:00100000:2.0:1788581043.784701:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+8:5613:x1875462995317504:12345-192.168.201.13@tcp:101: 00010000:00010000:2.0:1788581043.784724:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581043.784743:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91907bb82400/0xf54e3944c2a7001e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8f46 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581043.784776:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91907bb82400/0xf54e3944c2a7001e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f46 expref: 9 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581043.784787:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91907bb82400/0xf54e3944c2a7001e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f46 expref: 9 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581043.784798:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb82400, rc 0) 00000100:00100000:2.0:1788581043.784871:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+9:5613:x1875462995317504:12345-192.168.201.13@tcp:101: Request processed in 170us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581043.784878:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 165 00000100:00100000:3.0:1788581043.787389:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581043.788842:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995317632 00000100:00100000:2.0:1788581043.788856:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995317632 00000100:00100000:2.0:1788581043.788943:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 166 00000100:00100000:2.0:1788581043.788954:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+9:5613:x1875462995317632:12345-192.168.201.13@tcp:501: 00000100:00100000:2.0:1788581043.789310:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+9:5613:x1875462995317632:12345-192.168.201.13@tcp:501: Request processed in 357us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581043.789318:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 166 00000100:00100000:3.0:1788581043.795550:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581043.796309:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995317760 00000100:00100000:1.0:1788581043.796321:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995317760 00000100:00100000:1.0:1788581043.796385:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 167 00000100:00100000:1.0:1788581043.796406:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+9:5613:x1875462995317760:12345-192.168.201.13@tcp:503: 00000100:00100000:1.0:1788581043.796646:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+9:5613:x1875462995317760:12345-192.168.201.13@tcp:503: Request processed in 251us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581043.796654:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 167 00000100:00100000:1.0:1788581043.812067:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581043.812364:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995317888 00000100:00100000:3.0:1788581043.812376:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995317888 00000100:00100000:3.0:1788581043.812454:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 168 00000100:00100000:3.0:1788581043.812466:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+9:6085:x1875462995317888:12345-192.168.201.13@tcp:502: 00000100:00100000:3.0:1788581043.812758:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+9:6085:x1875462995317888:12345-192.168.201.13@tcp:502: Request processed in 292us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581043.812767:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 168 00000100:00100000:3.0:1788581043.815737:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581043.815856:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995318016 00000100:00100000:2.0:1788581043.815866:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995318016 00000100:00100000:2.0:1788581043.815920:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 169 00000100:00100000:2.0:1788581043.815930:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+9:6085:x1875462995318016:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788581043.816517:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+9:6085:x1875462995318016:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 586us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581043.816526:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 169 00000100:00100000:0.0:1788581043.826044:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581043.826316:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995318144 00000100:00100000:1.0:1788581043.826329:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995318144 00000100:00100000:1.0:1788581043.826379:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 170 00000100:00100000:1.0:1788581043.826389:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+9:5613:x1875462995318144:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581043.826424:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581043.826442:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919044ca8c00/0xf54e3944c2a70025 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8f4d expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581043.826470:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca8c00/0xf54e3944c2a70025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f4d expref: 10 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581043.826482:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919044ca8c00/0xf54e3944c2a70025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f4d expref: 10 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581043.826492:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8c00, rc 0) 00000100:00100000:1.0:1788581043.826572:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:5613:x1875462995318144:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 Request processed in 182us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581043.826579:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 170 00000100:00100000:1.0:1788581043.831407:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581043.832984:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995318272 00000100:00100000:2.0:1788581043.832996:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995318272 00000100:00100000:2.0:1788581043.833107:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 171 00000100:00100000:2.0:1788581043.833119:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:5613:x1875462995318272:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581043.834237:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:5613:x1875462995318272:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 Request processed in 1111us (2839us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581043.834300:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 171 00010000:00010000:0.0:1788581044.207622:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581044.337501:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014220032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581044.337577:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581044.337684:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014220032 00000100:00100000:2.0:1788581044.337693:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014220032 00000100:00100000:2.0:1788581044.337758:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788581044.337768:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014220032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581044.337938:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788581044.342003:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581044.344293:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014220032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6516us (6704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581044.344316:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788581044.344425:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907fc3ed80 x1875463014220032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581044.344449:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014220032:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788581044.802070:0:8553:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc66ba4c90 20000000:00000080:1.0:1788581044.802087:0:8553:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91906c918000 uarg=0000000000000000 20000000:01000000:1.0:1788581044.802199:0:8553:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788581044.802206:0:8553:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788581044.802211:0:8553:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788581044.803519:0:8554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788581044.803964:0:8553:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788581044.814442:0:8553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788581044.814499:0:8553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788581044.814556:0:8553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788581044.814574:0:8553:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788581044.814609:0:8553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91907bb82e00/0xf54e3944c2a7002c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.814628:0:8553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919044ca8a00/0xf54e3944c2a6fda1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fd9a expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.814636:0:8553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919044ca8000/0xf54e3944c2a6fe03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fdfc expref: 18 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.814935:0:8553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919040030200/0xf54e3944c2a6fece lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a6fec7 expref: 18 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.814946:0:8553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6ff8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f15 expref: 9 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.814953:0:8553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91907bb82e00/0xf54e3944c2a7002c lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.814994:0:8553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6ff8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f15 expref: 9 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.815023:0:8553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6ff8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f15 expref: 9 pid: 5870 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581044.815039:0:8553:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8553:1875463014220160:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581044.815402:0:8553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919040030200/0xf54e3944c2a6fece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6fec7 expref: 18 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.815411:0:8553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919040030200/0xf54e3944c2a6fece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6fec7 expref: 18 pid: 5869 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581044.815421:0:8553:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8553:1875463014220288:0@lo:104: 00000100:00100000:2.0:1788581044.815462:0:8553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581044.815501:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014220288 00000100:00100000:2.0:1788581044.815509:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014220288 00000100:00100000:2.0:1788581044.815554:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788581044.815562:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:8553:x1875463014220288:12345-0@lo:104: 00010000:00010000:2.0:1788581044.815574:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a6fec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fece expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.815630:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788581044.815637:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:8553:x1875463014220288:12345-0@lo:104: Request processed in 75us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581044.815725:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1788581044.815759:0:8553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919044ca8000/0xf54e3944c2a6fe03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6fdfc expref: 18 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.815767:0:8553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919044ca8000/0xf54e3944c2a6fe03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6fdfc expref: 18 pid: 5869 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581044.815784:0:8553:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8553:1875463014220416:0@lo:104: 00000100:00100000:2.0:1788581044.815893:0:8553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581044.815918:0:5859:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788581044.815928:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014220416 00000100:00100000:2.0:1788581044.815931:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014220416 00000100:00100000:2.0:1788581044.815947:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788581044.815952:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca8d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:8553:x1875463014220416:12345-0@lo:104: 00010000:00010000:2.0:1788581044.815959:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fdfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fe03 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.815989:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788581044.815993:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca8d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:8553:x1875463014220416:12345-0@lo:104: Request processed in 42us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581044.815999:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1788581044.816040:0:8553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919044ca8a00/0xf54e3944c2a6fda1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a6fd9a expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.816048:0:8553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919044ca8a00/0xf54e3944c2a6fda1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd9a expref: 18 pid: 5870 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581044.816056:0:8553:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8553:1875463014220544:0@lo:104: 00000100:00100000:2.0:1788581044.816076:0:8553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581044.816092:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014220544 00000100:00100000:2.0:1788581044.816095:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014220544 00000100:00100000:2.0:1788581044.816125:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788581044.816132:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:8553:x1875463014220544:12345-0@lo:104: 00010000:00010000:2.0:1788581044.816139:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff919040031400/0xf54e3944c2a6fd9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fda1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.816176:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788581044.816181:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:8553:x1875463014220544:12345-0@lo:104: Request processed in 50us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581044.816187:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788581044.816202:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788581044.816207:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a6fec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fece expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.816214:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cfa00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:2.0:1788581044.816217:0:5865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a6fec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6fece expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.816225:0:5865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a6fec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6fece expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581044.816232:0:5865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a6fec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6fece expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581044.816238:0:5865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788581044.816286:0:5865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a6fec7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fece expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.816293:0:5865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581044.816313:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a6fec7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fece expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.816320:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a6fec7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fece expref: -99 pid: 7675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.816342:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788581044.816345:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fdfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fe03 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.816353:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cee00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:2.0:1788581044.816356:0:5865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fdfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6fe03 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.816362:0:5865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fdfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6fe03 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581044.816369:0:5865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fdfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6fe03 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581044.816374:0:5865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788581044.816401:0:5865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fdfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe03 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.816407:0:5865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581044.816413:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fdfc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe03 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.816419:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a6fdfc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fe03 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.816429:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581044.816432:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919040031400/0xf54e3944c2a6fd9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a6fda1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.816447:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040031400 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:2.0:1788581044.816450:0:5865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919040031400/0xf54e3944c2a6fd9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a6fda1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.816456:0:5865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919040031400/0xf54e3944c2a6fd9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a6fda1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581044.816461:0:5865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919040031400/0xf54e3944c2a6fd9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a6fda1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581044.816466:0:5865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788581044.816480:0:5865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919040031400/0xf54e3944c2a6fd9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fda1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.816485:0:5865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581044.816500:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919040031400/0xf54e3944c2a6fd9a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fda1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.816508:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919040031400/0xf54e3944c2a6fd9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a6fda1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581044.816521:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581044.816522:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581044.816524:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581044.816537:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014220672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581044.816564:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581044.816587:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581044.816593:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014220800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581044.816637:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581044.818207:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014220928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581044.818313:0:8553:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907fc16840 going to sleep for 11 seconds 00000100:00100000:3.0:1788581044.818343:0:8553:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8553:1875463014220288:0@lo:104: 00000100:00100000:3.0:1788581044.818353:0:8553:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8553:1875463014220416:0@lo:104: 00000100:00100000:3.0:1788581044.818391:0:8553:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8553:1875463014220544:0@lo:104: 00000100:00100000:2.0:1788581044.818462:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788581044.818813:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581044.818820:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581044.819748:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014220672 00000100:00100000:3.0:1788581044.819760:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014220672 00010000:00010000:3.0:1788581044.819917:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919040030200/0xf54e3944c2a6fece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fec7 expref: 19 pid: 5869 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581044.819954:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014220800 00000100:00100000:3.0:1788581044.819957:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014220800 00010000:00010000:3.0:1788581044.819970:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919044ca8000/0xf54e3944c2a6fe03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fdfc expref: 20 pid: 5869 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581044.819980:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014220928 00000100:00100000:3.0:1788581044.819982:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014220928 00010000:00010000:3.0:1788581044.819990:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919044ca8a00/0xf54e3944c2a6fda1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd9a expref: 21 pid: 5870 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581044.820001:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788581044.820008:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+21:3338:x1875463014220672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581044.820021:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581044.820026:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919040030200/0xf54e3944c2a6fece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fec7 expref: 21 pid: 5869 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.820037:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919040030200/0xf54e3944c2a6fece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6fec7 expref: 21 pid: 5869 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.820052:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919040030200/0xf54e3944c2a6fece lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6fec7 expref: 21 pid: 5869 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.820066:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581044.820176:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+20:3338:x1875463014220672:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (3610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581044.820195:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788581044.820215:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788581044.820220:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3338:x1875463014220800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581044.820227:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581044.820231:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919044ca8000/0xf54e3944c2a6fe03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fdfc expref: 19 pid: 5869 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.820238:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919044ca8000/0xf54e3944c2a6fe03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6fdfc expref: 19 pid: 5869 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.820267:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919044ca8000/0xf54e3944c2a6fe03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6fdfc expref: 19 pid: 5869 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.820275:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581044.820298:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:3338:x1875463014220800:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (3661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581044.820303:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788581044.820314:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788581044.820319:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:3340:x1875463014220928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581044.820326:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581044.820330:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919044ca8a00/0xf54e3944c2a6fda1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd9a expref: 17 pid: 5870 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.820336:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919044ca8a00/0xf54e3944c2a6fda1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a6fd9a expref: 17 pid: 5870 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.820344:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919044ca8a00/0xf54e3944c2a6fda1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a6fd9a expref: 17 pid: 5870 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.820360:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581044.820402:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:3340:x1875463014220928:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (1940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581044.820409:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788581044.821054:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014220928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581044.821201:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014220672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581044.821437:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014220800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581044.829658:0:8553:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8553:1875463014220160:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581044.829701:0:8553:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91907bb82e00/0xf54e3944c2a7002c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581044.830037:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581044.830190:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995318400 00000100:00100000:3.0:1788581044.830200:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995318400 00010000:00010000:3.0:1788581044.830239:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6ff8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f15 expref: 10 pid: 5870 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581044.830341:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 24 00000100:00100000:3.0:1788581044.830352:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2374:x1875462995318400:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581044.830368:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581044.830374:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6ff8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f15 expref: 10 pid: 5870 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.830398:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6ff8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f15 expref: 10 pid: 5870 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.830416:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190414b3400/0xf54e3944c2a6ff8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f15 expref: 10 pid: 5870 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.830432:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91907bb82e00/0xf54e3944c2a7002c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.830457:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91907bb82e00/0xf54e3944c2a7002c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.830473:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91907bb82e00/0xf54e3944c2a7002c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.830480:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91907bb82e00/0xf54e3944c2a7002c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.830487:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91907bb82e00/0xf54e3944c2a7002c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.830494:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91907bb82e00/0xf54e3944c2a7002c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.830499:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb82e00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581044.830504:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91907bb82e00/0xf54e3944c2a7002c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.830511:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91907bb82e00/0xf54e3944c2a7002c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.830537:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91907bb82e00/0xf54e3944c2a7002c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581044.830547:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581044.830685:0:8553:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91907bb82e00/0xf54e3944c2a7002c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581044.830693:0:8553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91907bb82e00/0xf54e3944c2a7002c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581044.830698:0:8553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91907bb82e00/0xf54e3944c2a7002c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581044.830985:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+9:2374:x1875462995318400:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 632us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581044.830994:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 24 00010000:00010000:2.0:1788581045.231419:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581045.235592:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581045.235747:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995318528 00000100:00100000:3.0:1788581045.235772:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995318528 00000100:00100000:3.0:1788581045.235836:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 172 00000100:00100000:3.0:1788581045.235848:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+9:5613:x1875462995318528:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581045.235866:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581045.235887:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190414b3400/0xf54e3944c2a70033 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8f54 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581045.235915:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190414b3400/0xf54e3944c2a70033 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f54 expref: 10 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581045.235926:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190414b3400/0xf54e3944c2a70033 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f54 expref: 10 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581045.235937:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190414b3400, rc 0) 00000100:00100000:3.0:1788581045.235999:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:5613:x1875462995318528:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 Request processed in 153us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581045.236006:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 172 00000100:00100000:2.0:1788581045.243695:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581045.243827:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995318656 00000100:00100000:1.0:1788581045.243839:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995318656 00000100:00100000:1.0:1788581045.243908:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 173 00000100:00100000:1.0:1788581045.243919:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:5613:x1875462995318656:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581045.244384:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:5613:x1875462995318656:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 Request processed in 302us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581045.244400:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 173 00000100:00100000:0.0:1788581045.255703:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581045.255915:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995318784 00000100:00100000:1.0:1788581045.255926:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995318784 00000100:00100000:1.0:1788581045.256049:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 174 00000100:00100000:1.0:1788581045.256061:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:5613:x1875462995318784:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581045.256356:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:5613:x1875462995318784:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 Request processed in 297us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581045.256365:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 174 00000100:00100000:0.0:1788581045.267705:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581045.267871:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995318912 00000100:00100000:3.0:1788581045.267881:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995318912 00000100:00100000:3.0:1788581045.267939:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 175 00000100:00100000:3.0:1788581045.267949:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:6143:x1875462995318912:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788581045.268204:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:6143:x1875462995318912:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 254us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581045.268212:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 175 00000100:00100000:0.0:1788581045.289778:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581045.292683:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995319040 00000100:00100000:1.0:1788581045.292698:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995319040 00000100:00100000:1.0:1788581045.292771:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 176 00000100:00100000:1.0:1788581045.292781:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:6143:x1875462995319040:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788581045.293047:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:6143:x1875462995319040:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 264us (3276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581045.293055:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 176 00010000:00010000:0.0:1788581046.259276:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581046.660666:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581046.660712:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581046.660744:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581046.660791:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581046.660823:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995319296 00000100:00100000:3.0:1788581046.660832:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995319296 00000100:00100000:3.0:1788581046.660895:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 30 00000100:00100000:3.0:1788581046.660907:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2372:x1875462995319296:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581046.660985:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2372:x1875462995319296:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 82us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581046.660992:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 30 00000100:00100000:3.0:1788581046.661016:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995319424 00000100:00100000:3.0:1788581046.661020:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995319424 00000100:00100000:3.0:1788581046.661046:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995319552 00000100:00100000:3.0:1788581046.661049:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995319552 00000100:00100000:3.0:1788581046.661064:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:3.0:1788581046.661070:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2372:x1875462995319424:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581046.661096:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2372:x1875462995319424:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 27us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581046.661102:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:3.0:1788581046.661115:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:3.0:1788581046.661121:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2372:x1875462995319552:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581046.661142:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2372:x1875462995319552:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 22us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581046.661148:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00080000:3.0:1788581046.661164:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581046.661167:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581046.661170:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581046.664404:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995319168 00000100:00100000:2.0:1788581046.664421:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995319168 00000100:00100000:2.0:1788581046.664497:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 177 00000100:00100000:2.0:1788581046.664507:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2372:x1875462995319168:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581046.664590:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2372:x1875462995319168:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 84us (3935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581046.664598:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 177 10000000:01000000:0.0:1788581046.832544:0:5874:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788581046.832552:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91907f8f1000 from 4 10000000:01000000:0.0:1788581046.832556:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581046.832599:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a7003a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.832612:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a7003a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.832623:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a7003a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581046.832650:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014221056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.832718:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581046.832783:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581046.832806:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014221056 00000100:00100000:0.0:1788581046.832821:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014221056 00000100:00100000:0.0:1788581046.832869:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788581046.832878:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014221056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581046.832893:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581046.832904:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919040030a00/0xf54e3944c2a70041 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a7003a expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.832925:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919040030a00/0xf54e3944c2a70041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a7003a expref: 17 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.832934:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919040030a00/0xf54e3944c2a70041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a7003a expref: 17 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.832942:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919040030a00, rc 0) 00000100:00100000:0.0:1788581046.832981:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014221056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581046.832987:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788581046.833033:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014221056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581046.833046:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a7003a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70041 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.833053:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a7003a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a70041 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581046.833105:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014221184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.833131:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581046.833149:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581046.833161:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014221184 00000100:00100000:0.0:1788581046.833170:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014221184 00000100:00100000:0.0:1788581046.833191:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788581046.833199:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014221184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.834064:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014221184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 862us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581046.834074:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788581046.834126:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014221184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.834160:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014221312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.834201:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581046.834229:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581046.834537:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014221312 00000100:00100000:0.0:1788581046.834543:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014221312 00000100:00100000:0.0:1788581046.834575:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788581046.834581:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014221312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.834731:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014221312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581046.834738:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788581046.834793:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014221312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.834988:0:8637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8637:1875463014221440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581046.835024:0:8637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581046.835047:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014221440 00000100:00100000:0.0:1788581046.835052:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014221440 00000100:00100000:0.0:1788581046.835073:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788581046.835079:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:8637:x1875463014221440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581046.835224:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:8637:x1875463014221440:12345-0@lo:502:llog_process_th.0 Request processed in 144us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581046.835274:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788581046.835314:0:8637:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581046.835327:0:8637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8637:1875463014221440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581046.835358:0:8637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581046.835368:0:8637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581046.835371:0:8637:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788581046.835382:0:8637:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91907f8f1000 00000020:00000080:0.0:1788581046.835385:0:8637:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788581046.836019:0:8637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8637:1875463014221568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581046.836064:0:8637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581046.836100:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014221568 00000100:00100000:0.0:1788581046.836105:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014221568 00000100:00100000:0.0:1788581046.836198:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788581046.836205:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:8637:x1875463014221568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581046.836990:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:8637:x1875463014221568:12345-0@lo:502:llog_process_th.0 Request processed in 781us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581046.837000:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788581046.837056:0:8637:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581046.837073:0:8637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8637:1875463014221568:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581046.837101:0:8637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581046.837107:0:8637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581046.837109:0:8637:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788581046.838640:0:8637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788581046.838849:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788581046.838869:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788581046.838879:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a7003a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70041 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.838898:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a7003a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70041 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581046.838910:0:5874:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788581046.838912:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91906c6c6000 from 4 10000000:01000000:0.0:1788581046.838915:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581046.838944:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a70048 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.838952:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a70048 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.838961:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a70048 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581046.838980:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014221696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.839033:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581046.839075:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581046.839091:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014221696 00000100:00100000:0.0:1788581046.839097:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014221696 00000100:00100000:0.0:1788581046.839141:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788581046.839149:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014221696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581046.839159:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581046.839169:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919040031400/0xf54e3944c2a7004f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a70048 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.839189:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919040031400/0xf54e3944c2a7004f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a70048 expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.839209:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919040031400/0xf54e3944c2a7004f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a70048 expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.839217:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919040031400, rc 0) 00000100:00100000:0.0:1788581046.839379:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014221696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581046.839385:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788581046.841671:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014221696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581046.841701:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a70048 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7004f expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.841713:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a70048 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a7004f expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581046.841796:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014221824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.841846:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581046.841886:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581046.841903:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014221824 00000100:00100000:0.0:1788581046.841908:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014221824 00000100:00100000:0.0:1788581046.841944:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788581046.841952:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014221824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.842208:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014221824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581046.842216:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788581046.842283:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014221824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.842318:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014221952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.842369:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581046.842391:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581046.843360:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014221952 00000100:00100000:0.0:1788581046.843369:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014221952 00000100:00100000:0.0:1788581046.843419:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788581046.843428:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014221952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.843597:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014221952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581046.843605:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788581046.843654:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014221952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.845656:0:8639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8639:1875463014222080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581046.845733:0:8639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581046.845838:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014222080 00000100:00100000:0.0:1788581046.845844:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014222080 00000100:00100000:0.0:1788581046.845883:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788581046.845892:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:8639:x1875463014222080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581046.846083:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:8639:x1875463014222080:12345-0@lo:502:llog_process_th.0 Request processed in 191us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581046.846091:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788581046.847593:0:8639:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788581046.847630:0:8639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8639:1875463014222080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581046.850238:0:8639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581046.850337:0:8639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581046.850355:0:8639:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788581046.850368:0:8639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91906c6c6000 00000020:00000080:0.0:1788581046.850371:0:8639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788581046.850551:0:8639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8639:1875463014222208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581046.850625:0:8639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581046.850682:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014222208 00000100:00100000:0.0:1788581046.850688:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014222208 00000100:00100000:0.0:1788581046.850731:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788581046.850739:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:8639:x1875463014222208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581046.853059:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:8639:x1875463014222208:12345-0@lo:502:llog_process_th.0 Request processed in 2311us (2425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581046.853072:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788581046.858340:0:8639:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048207e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581046.858410:0:8639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8639:1875463014222208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788581046.858451:0:8639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581046.858462:0:8639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581046.858464:0:8639:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788581046.858471:0:8639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788581046.859942:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788581046.859971:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788581046.859983:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a70048 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7004f expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.859996:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a70048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7004f expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581046.860013:0:5874:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788581046.860015:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91904733b800 from 4 10000000:01000000:0.0:1788581046.860018:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581046.860058:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040030200/0xf54e3944c2a70056 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.860066:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919040030200/0xf54e3944c2a70056 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.860078:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919040030200/0xf54e3944c2a70056 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581046.861916:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014222336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.861990:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581046.862047:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048207e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581046.862084:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014222336 00000100:00100000:0.0:1788581046.862092:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014222336 00000100:00100000:0.0:1788581046.862420:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788581046.862431:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014222336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581046.862446:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581046.862464:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919040031a00/0xf54e3944c2a7005d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a70056 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.862489:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919040031a00/0xf54e3944c2a7005d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a70056 expref: 19 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.862499:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919040031a00/0xf54e3944c2a7005d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a70056 expref: 19 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.862507:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919040031a00, rc 0) 00000100:00100000:0.0:1788581046.862551:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014222336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581046.862557:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788581046.862606:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014222336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581046.862621:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919040030200/0xf54e3944c2a70056 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7005d expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.862628:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919040030200/0xf54e3944c2a70056 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a7005d expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581046.862691:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014222464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.862713:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581046.862735:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048207e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581046.862748:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014222464 00000100:00100000:0.0:1788581046.862751:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014222464 00000100:00100000:0.0:1788581046.867330:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788581046.867353:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014222464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.867663:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014222464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (4947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581046.867672:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788581046.867740:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014222464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.867790:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014222592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.867835:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581046.867868:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048207e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581046.867882:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014222592 00000100:00100000:0.0:1788581046.867887:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014222592 00000100:00100000:0.0:1788581046.867911:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788581046.867916:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014222592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.868056:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014222592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581046.868064:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788581046.868101:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014222592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581046.868302:0:8641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8641:1875463014222720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581046.868337:0:8641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581046.868372:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014222720 00000100:00100000:0.0:1788581046.868376:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014222720 00000100:00100000:0.0:1788581046.868399:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788581046.868405:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:8641:x1875463014222720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581046.868532:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:8641:x1875463014222720:12345-0@lo:502:llog_process_th.0 Request processed in 126us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581046.868539:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788581046.868573:0:8641:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190720bbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581046.868585:0:8641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8641:1875463014222720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581046.868606:0:8641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581046.868624:0:8641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581046.868627:0:8641:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788581046.868634:0:8641:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91904733b800 00000020:00000080:0.0:1788581046.868636:0:8641:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788581046.868706:0:8641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8641:1875463014222848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581046.868739:0:8641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581046.868758:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014222848 00000100:00100000:0.0:1788581046.868762:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014222848 00000100:00100000:0.0:1788581046.868782:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788581046.868787:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:8641:x1875463014222848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581046.868886:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:8641:x1875463014222848:12345-0@lo:502:llog_process_th.0 Request processed in 98us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581046.868892:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788581046.868918:0:8641:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048da8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581046.868929:0:8641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:8641:1875463014222848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581046.868950:0:8641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581046.868954:0:8641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581046.868956:0:8641:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788581046.868959:0:8641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788581046.869010:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788581046.869022:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788581046.869031:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040030200/0xf54e3944c2a70056 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7005d expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581046.869042:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919040030200/0xf54e3944c2a70056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7005d expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581046.897712:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014223360:0@lo:400:kworker.0 00000100:00100000:3.0:1788581046.898518:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014222976:0@lo:400:kworker.0 00000100:00100000:1.0:1788581046.904325:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014223232:0@lo:400:kworker.0 00000100:00100000:3.0:1788581046.905877:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581046.905925:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014223488:0@lo:400:kworker.0 00000100:00100000:3.0:1788581046.905961:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581046.906013:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014222976 00000100:00100000:3.0:1788581046.906020:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014222976 00000100:00100000:3.0:1788581046.906068:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788581046.906077:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014222976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581046.906132:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014222976:12345-0@lo:400:kworker.0 Request processed in 56us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581046.906139:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788581046.906163:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014223488 00000100:00100000:3.0:1788581046.906167:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014223488 00000100:00100000:3.0:1788581046.906198:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788581046.906204:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014223488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581046.906236:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014223488:12345-0@lo:400:kworker.0 Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581046.906257:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788581046.906275:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581046.906308:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014222976:0@lo:400:kworker.0 00010000:00080000:3.0:1788581046.906319:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919075b75c00 x1875463014223488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581046.906328:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014223488:0@lo:400:kworker.0 00000100:00100000:2.0:1788581046.912602:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581046.912683:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014223360 00000100:00100000:2.0:1788581046.912691:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014223360 00000100:00100000:2.0:1788581046.912747:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788581046.912770:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014223360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581046.912835:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014223360:12345-0@lo:400:kworker.0 Request processed in 80us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581046.912842:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788581046.912866:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581046.912914:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014223360:0@lo:400:kworker.0 00000100:00100000:0.0:1788581046.915697:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014223104:0@lo:400:kworker.0 00000100:00100000:0.0:1788581046.917111:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581046.917354:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014223104 00000100:00100000:3.0:1788581046.917494:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014223104 00000100:00100000:3.0:1788581046.917563:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788581046.917572:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014223104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581046.917646:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014223104:12345-0@lo:400:kworker.0 Request processed in 75us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581046.917653:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788581046.917703:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014223104:0@lo:400:kworker.0 00000100:00080000:0.0:1788581046.918558:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581046.925334:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581046.925875:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014223232 00000100:00100000:1.0:1788581046.925886:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014223232 00000100:00100000:1.0:1788581046.925956:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788581046.925972:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014223232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581046.926042:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014223232:12345-0@lo:400:kworker.0 Request processed in 71us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581046.926049:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788581046.926182:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919075b75500 x1875463014223232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581046.926196:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014223232:0@lo:400:kworker.0 00000100:00080000:0.0:1788581046.926676:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788581047.284826:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581047.412948:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581047.412971:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014223616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581047.413040:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581047.416704:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014223616 00000100:00100000:2.0:1788581047.416726:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014223616 00000100:00100000:2.0:1788581047.416804:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581047.416815:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014223616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581047.416851:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581047.416930:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014223616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (3890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581047.416938:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788581047.420784:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919075b76300 x1875463014223616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581047.420813:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014223616:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788581048.311656:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581049.327965:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581049.455793:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014223744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581049.455866:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581049.459068:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014223744 00000100:00100000:0.0:1788581049.459083:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014223744 00000100:00100000:0.0:1788581049.459152:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788581049.459165:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014223744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581049.459204:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581049.459405:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014223744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 243us (3538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581049.459420:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788581049.459443:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788581049.462293:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907fc3e300 x1875463014223744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581049.462334:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014223744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788581050.356661:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788581051.182702:0:8853:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1788581051.375413:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581051.780069:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581051.780113:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581051.780156:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581051.780192:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581051.780301:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995319808 00000100:00100000:2.0:1788581051.780312:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995319808 00000100:00100000:2.0:1788581051.780393:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00100000:2.0:1788581051.780405:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2373:x1875462995319808:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581051.780490:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2373:x1875462995319808:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 87us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581051.780498:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00100000:0.0:1788581051.780521:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995320064 00000100:00100000:0.0:1788581051.780525:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995320064 00000100:00100000:0.0:1788581051.780565:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995319936 00000100:00100000:0.0:1788581051.780569:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995319936 00000100:00100000:0.0:1788581051.780590:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:0.0:1788581051.780597:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2373:x1875462995320064:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581051.780630:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2373:x1875462995320064:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 34us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581051.780636:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:0.0:1788581051.780656:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:0.0:1788581051.780663:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2373:x1875462995319936:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581051.780686:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2373:x1875462995319936:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 24us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581051.780691:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:1.0:1788581051.780821:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995319680 00000100:00100000:1.0:1788581051.780826:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995319680 00000100:00100000:1.0:1788581051.780862:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 193 00000100:00100000:1.0:1788581051.780869:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2373:x1875462995319680:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581051.780897:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2373:x1875462995319680:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 29us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581051.780903:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 193 00000100:00080000:2.0:1788581051.784092:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788581051.784103:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581051.784106:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581052.019566:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014224256:0@lo:400:kworker.0 00000100:00100000:2.0:1788581052.019645:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014223872:0@lo:400:kworker.0 00000100:00100000:1.0:1788581052.019655:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581052.019717:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014224000:0@lo:400:kworker.0 00000100:00100000:0.0:1788581052.019781:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014224128:0@lo:400:kworker.0 00000100:00100000:2.0:1788581052.025669:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581052.025756:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014224384:0@lo:400:kworker.0 00000100:00100000:2.0:1788581052.025801:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581052.025858:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014224384 00000100:00100000:2.0:1788581052.028642:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014224384 00000100:00100000:2.0:1788581052.028737:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788581052.028751:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014224384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581052.028856:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014224384:12345-0@lo:400:kworker.0 Request processed in 110us (3053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581052.028883:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1788581052.028912:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581052.028952:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014224384:0@lo:400:kworker.0 00000100:00100000:2.0:1788581052.028999:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014224256 00000100:00100000:2.0:1788581052.029004:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014224256 00000100:00100000:2.0:1788581052.029034:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788581052.029040:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014224256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581052.029087:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014224256:12345-0@lo:400:kworker.0 Request processed in 36us (9420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581052.029102:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788581052.029121:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581052.029145:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014223872 00000100:00100000:2.0:1788581052.029148:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014223872 00000100:00100000:2.0:1788581052.029171:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788581052.029177:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014223872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581052.029212:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014223872:12345-0@lo:400:kworker.0 Request processed in 36us (3553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581052.029218:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788581052.029283:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014223872:0@lo:400:kworker.0 00010000:00080000:1.0:1788581052.029667:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076317100 x1875463014224256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581052.029679:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014224256:0@lo:400:kworker.0 00000100:00100000:3.0:1788581052.038199:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581052.038277:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014224512:0@lo:400:kworker.0 00000100:00100000:3.0:1788581052.038322:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581052.038438:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014224000 00000100:00100000:1.0:1788581052.038448:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014224000 00000100:00100000:1.0:1788581052.038506:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788581052.038515:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014224000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581052.038574:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014224000:12345-0@lo:400:kworker.0 Request processed in 60us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581052.038580:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788581052.038825:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014224512 00000100:00100000:2.0:1788581052.038830:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014224512 00000100:00100000:2.0:1788581052.038881:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788581052.038889:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014224512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581052.038926:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014224512:12345-0@lo:400:kworker.0 Request processed in 40us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581052.038945:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788581052.039018:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581052.039095:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014224000:0@lo:400:kworker.0 00010000:00080000:3.0:1788581052.039110:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076315180 x1875463014224512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581052.039120:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014224512:0@lo:400:kworker.0 00000100:00100000:0.0:1788581052.040628:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581052.040781:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014224128 00000100:00100000:2.0:1788581052.040790:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014224128 00000100:00100000:2.0:1788581052.040859:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788581052.040869:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014224128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581052.040939:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014224128:12345-0@lo:400:kworker.0 Request processed in 71us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581052.040946:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788581052.041043:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014224128:0@lo:400:kworker.0 00000100:00080000:1.0:1788581052.041118:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788581052.400231:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581052.527731:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581052.527757:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014224640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581052.527832:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581052.528060:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014224640 00000100:00100000:0.0:1788581052.528068:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014224640 00000100:00100000:0.0:1788581052.528141:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788581052.528152:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014224640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788581052.528187:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581052.528282:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014224640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581052.528306:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788581052.528791:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919075b76300 x1875463014224640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581052.528811:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014224640:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788581053.426319:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581054.449724:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581054.577096:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014224768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581054.577172:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581054.577357:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014224768 00000100:00100000:1.0:1788581054.577366:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014224768 00000100:00100000:1.0:1788581054.577438:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788581054.577442:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581054.577449:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014224768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581054.577483:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581054.580850:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014224768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3393us (3667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581054.581043:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788581054.585425:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907fc3ea00 x1875463014224768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581054.585453:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014224768:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788581055.474352:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581056.497066:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581056.905333:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581056.905377:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581056.905463:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995320192 00000100:00100000:1.0:1788581056.905485:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995320192 00000100:00100000:1.0:1788581056.905542:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 195 00000100:00100000:1.0:1788581056.905553:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2372:x1875462995320192:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581056.905633:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2372:x1875462995320192:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 81us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581056.905640:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 195 00000100:00100000:0.0:1788581056.906238:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995320320 00000100:00100000:0.0:1788581056.906271:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995320320 00000100:00100000:0.0:1788581056.906335:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 38 00000100:00100000:0.0:1788581056.906343:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2372:x1875462995320320:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581056.906388:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2372:x1875462995320320:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 45us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581056.906395:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 38 00000100:00100000:0.0:1788581056.906441:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581056.906524:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581056.906544:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995320448 00000100:00100000:0.0:1788581056.906547:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995320448 00000100:00100000:0.0:1788581056.906571:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995320576 00000100:00100000:0.0:1788581056.906574:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995320576 00000100:00100000:0.0:1788581056.906598:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:0.0:1788581056.906604:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2371:x1875462995320448:12345-192.168.201.13@tcp:9:kworker.0 00000020:00000080:0.0:1788581056.906629:0:6725:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6ff99 00000100:00080000:0.0:1788581056.906638:0:6725:0:(import.c:65:import_set_state_nolock()) ffff91907630f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788581056.906674:0:6725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:3.0:1788581056.906939:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581056.906943:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581056.906945:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581056.907524:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+2:2371:x1875462995320448:12345-192.168.201.13@tcp:9:kworker.0 Request processed in 916us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581056.907533:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:0.0:1788581056.907552:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:0.0:1788581056.907560:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2371:x1875462995320576:12345-192.168.201.13@tcp:9:kworker.0 00000020:00000080:0.0:1788581056.907577:0:6725:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6ffa0 00000100:00080000:0.0:1788581056.907591:0:6725:0:(import.c:65:import_set_state_nolock()) ffff91907f903000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788581056.907616:0:6725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788581056.912738:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581056.912765:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581056.915424:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+2:2371:x1875462995320576:12345-192.168.201.13@tcp:9:kworker.0 Request processed in 7853us (8887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581056.915441:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:1.0:1788581057.137534:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014224896:0@lo:400:kworker.0 00000100:00100000:1.0:1788581057.137629:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581057.137677:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014225408:0@lo:400:kworker.0 00000100:00100000:1.0:1788581057.137704:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581057.137731:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788581057.137738:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014225024:0@lo:400:kworker.0 00000100:00100000:1.0:1788581057.137759:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581057.137777:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014225536:0@lo:400:kworker.0 00000100:00100000:1.0:1788581057.137799:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581057.137829:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014225152:0@lo:400:kworker.0 00000100:00100000:1.0:1788581057.137850:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581057.137868:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581057.137873:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014225280:0@lo:400:kworker.0 00000100:00100000:1.0:1788581057.137893:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581057.137929:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014224896 00000100:00100000:1.0:1788581057.137937:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014224896 00000100:00100000:1.0:1788581057.137984:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788581057.137994:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014224896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581057.138060:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014224896:12345-0@lo:400:kworker.0 Request processed in 68us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581057.138068:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788581057.138100:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014225408 00000100:00100000:1.0:1788581057.138104:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014225408 00000100:00100000:1.0:1788581057.138131:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014225024 00000100:00100000:1.0:1788581057.138134:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014225024 00000100:00100000:1.0:1788581057.138144:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014225152 00000100:00100000:1.0:1788581057.138146:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014225152 00000100:00100000:1.0:1788581057.138160:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788581057.138179:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014225408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581057.138211:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014225408:12345-0@lo:400:kworker.0 Request processed in 45us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581057.138218:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788581057.138230:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788581057.138235:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014225024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581057.138299:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014225024:12345-0@lo:400:kworker.0 Request processed in 63us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581057.138305:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788581057.138317:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788581057.138323:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014225152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581057.138356:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014225152:12345-0@lo:400:kworker.0 Request processed in 33us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581057.138362:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788581057.138382:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014225536 00000100:00100000:1.0:1788581057.138385:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014225536 00000100:00100000:1.0:1788581057.138408:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014225280 00000100:00100000:1.0:1788581057.138418:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014225280 00000100:00100000:1.0:1788581057.138436:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788581057.138441:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014225536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581057.138473:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014225536:12345-0@lo:400:kworker.0 Request processed in 32us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581057.138479:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788581057.138490:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788581057.138496:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014225280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581057.138522:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014225280:12345-0@lo:400:kworker.0 Request processed in 28us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581057.138528:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788581057.138570:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014225024:0@lo:400:kworker.0 00010000:00080000:1.0:1788581057.138583:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076314380 x1875463014225536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581057.138593:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014225536:0@lo:400:kworker.0 00000100:00100000:1.0:1788581057.138602:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014224896:0@lo:400:kworker.0 00000100:00100000:1.0:1788581057.138610:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014225408:0@lo:400:kworker.0 00000100:00080000:1.0:1788581057.138638:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581057.138642:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788581057.138644:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788581057.138658:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076316680 x1875463014225280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581057.138668:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014225280:0@lo:400:kworker.0 00000100:00100000:1.0:1788581057.138676:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014225152:0@lo:400:kworker.0 00010000:00010000:3.0:1788581057.544312:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581057.649139:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014225664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581057.649221:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581057.649381:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014225664 00000100:00100000:2.0:1788581057.649388:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014225664 00000100:00100000:2.0:1788581057.649442:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788581057.649451:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014225664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581057.649485:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581057.649533:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014225664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581057.649554:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788581057.649604:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919075b75500 x1875463014225664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581057.649621:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014225664:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788581058.465094:0:9097:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing yml_node 00010000:00010000:1.0:1788581058.607627:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581059.639043:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581059.705596:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581059.705624:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014225792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581059.708576:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581059.713892:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014225792 00000100:00100000:1.0:1788581059.713910:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014225792 00000100:00100000:1.0:1788581059.714145:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788581059.714156:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014225792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581059.714192:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581059.714286:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014225792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (8589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581059.714293:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788581059.715428:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076316680 x1875463014225792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581059.715451:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014225792:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788581059.725846:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788581060.655516:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788581060.790004:0:7696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11f1870a-1d9b-4af2-bb25-e81f8742df75 00000020:00000080:2.0:1788581060.790015:0:7696:0:(genops.c:885:class_export_put()) final put ffff91907f902800/11f1870a-1d9b-4af2-bb25-e81f8742df75 00000020:00000080:3.0:1788581060.790067:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91907f902800/11f1870a-1d9b-4af2-bb25-e81f8742df75 for lustre-OST0001 00000020:00000080:3.0:1788581060.793850:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91907f903000 for lustre-OST0001 00000001:00100000:2.0:1788581061.300977:0:6750:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11f1870a-1d9b-4af2-bb25-e81f8742df75 00000020:00000080:2.0:1788581061.300987:0:6750:0:(genops.c:885:class_export_put()) final put ffff91907630b800/11f1870a-1d9b-4af2-bb25-e81f8742df75 00000020:00000080:0.0:1788581061.301069:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91907630b800/11f1870a-1d9b-4af2-bb25-e81f8742df75 for lustre-OST0000 00000020:00000080:0.0:1788581061.301141:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91907630f000 for lustre-OST0000 00010000:00010000:1.0:1788581061.682296:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581062.025433:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581062.025559:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995320832 00000100:00100000:1.0:1788581062.025642:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995320832 00000100:00080000:3.0:1788581062.025780:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581062.025899:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:1.0:1788581062.025911:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995320832:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581062.026001:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995320832:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 92us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581062.026009:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:0.0:1788581062.037738:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581062.037901:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995320704 00000100:00100000:3.0:1788581062.037912:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995320704 00000100:00100000:3.0:1788581062.037975:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 197 00000100:00100000:3.0:1788581062.037987:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2375:x1875462995320704:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581062.038068:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2375:x1875462995320704:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 82us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581062.038076:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 197 00000100:00100000:0.0:1788581062.265416:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014226048:0@lo:400:kworker.0 00000100:00100000:2.0:1788581062.265421:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014226176:0@lo:400:kworker.0 00000100:00100000:1.0:1788581062.265700:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014225920:0@lo:400:kworker.0 00000100:00100000:0.0:1788581062.279413:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581062.279504:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014226560:0@lo:400:kworker.0 00000100:00100000:0.0:1788581062.279534:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581062.279593:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014226304:0@lo:400:kworker.0 00000100:00100000:2.0:1788581062.281384:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014226048 00000100:00100000:2.0:1788581062.281400:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014226048 00000100:00100000:2.0:1788581062.281458:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788581062.281469:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014226048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581062.281568:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014226048:12345-0@lo:400:kworker.0 Request processed in 89us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581062.281575:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788581062.281644:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014226048:0@lo:400:kworker.0 00000100:00100000:2.0:1788581062.281695:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014226560 00000100:00100000:2.0:1788581062.281700:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014226560 00000100:00100000:2.0:1788581062.281752:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788581062.281759:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014226560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581062.281797:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014226560:12345-0@lo:400:kworker.0 Request processed in 40us (2262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581062.281803:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788581062.281831:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190474c1500 x1875463014226560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581062.281842:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014226560:0@lo:400:kworker.0 00000100:00080000:2.0:1788581062.281865:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581062.282723:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581062.283493:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581062.283540:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014226432:0@lo:400:kworker.0 00000100:00100000:1.0:1788581062.283580:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581062.283615:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014226432 00000100:00100000:1.0:1788581062.283621:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014226432 00000100:00100000:1.0:1788581062.283672:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788581062.283680:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014226432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581062.283722:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014226432:12345-0@lo:400:kworker.0 Request processed in 43us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581062.283728:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788581062.283770:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014226432:0@lo:400:kworker.0 00000100:00100000:3.0:1788581062.286787:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581062.286962:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014226304 00000100:00100000:2.0:1788581062.286972:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014226304 00000100:00100000:2.0:1788581062.287046:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788581062.287057:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014226304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581062.287131:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014226304:12345-0@lo:400:kworker.0 Request processed in 77us (4411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581062.287138:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788581062.287172:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788581062.287177:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581062.287186:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014226176 00000100:00100000:2.0:1788581062.287190:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014226176 00000100:00100000:2.0:1788581062.287232:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788581062.287239:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014226176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581062.287526:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014226176:12345-0@lo:400:kworker.0 Request processed in 286us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581062.287547:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788581062.287576:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581062.288156:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014226176:0@lo:400:kworker.0 00000100:00100000:0.0:1788581062.289347:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014225920 00000100:00100000:0.0:1788581062.289357:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014225920 00000100:00100000:0.0:1788581062.289413:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788581062.289423:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014225920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581062.289515:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014225920:12345-0@lo:400:kworker.0 Request processed in 94us (6024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581062.289522:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00010000:00080000:0.0:1788581062.289572:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190474c2a00 x1875463014226304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581062.289578:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014225920:0@lo:400:kworker.0 00000100:00100000:0.0:1788581062.289584:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014226304:0@lo:400:kworker.0 00010000:00010000:1.0:1788581062.704235:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581062.767833:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581062.772976:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014226688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581062.773115:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581062.773723:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014226688 00000100:00100000:1.0:1788581062.773732:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014226688 00000100:00100000:1.0:1788581062.773793:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788581062.773803:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014226688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581062.773840:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581062.773904:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014226688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581062.773912:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788581062.774462:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190474c1500 x1875463014226688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581062.774496:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014226688:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788581063.727781:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581064.754893:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581064.815784:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581064.815808:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014226816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581064.815875:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581064.816197:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014226816 00000100:00100000:1.0:1788581064.816205:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014226816 00000100:00100000:1.0:1788581064.816291:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788581064.816300:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014226816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581064.816336:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581064.816385:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014226816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581064.816392:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788581064.816426:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076316d80 x1875463014226816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581064.816452:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014226816:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788581064.816517:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788581065.158450:0:9292:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00010000:00010000:1.0:1788581065.777959:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581066.804803:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581067.141050:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581067.141129:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581067.141195:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995320960 00000100:00100000:1.0:1788581067.141208:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995320960 00000100:00100000:1.0:1788581067.141299:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 199 00000100:00100000:1.0:1788581067.141312:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2373:x1875462995320960:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581067.141405:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2373:x1875462995320960:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 94us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581067.141412:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 199 00000100:00100000:2.0:1788581067.141628:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995321088 00000100:00100000:2.0:1788581067.141635:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995321088 00000100:00100000:2.0:1788581067.141811:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:2.0:1788581067.141820:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2373:x1875462995321088:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581067.141870:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2373:x1875462995321088:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 51us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581067.141877:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00080000:0.0:1788581067.144647:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581067.375620:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014227328:0@lo:400:kworker.0 00000100:00100000:0.0:1788581067.375710:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581067.375830:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581067.375837:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014227200:0@lo:400:kworker.0 00000100:00100000:0.0:1788581067.375867:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581067.375907:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014227328 00000100:00100000:0.0:1788581067.375914:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014227328 00000100:00100000:0.0:1788581067.375976:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788581067.375987:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014227328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581067.376055:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014227328:12345-0@lo:400:kworker.0 Request processed in 70us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581067.376062:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788581067.376085:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788581067.376112:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907f873100 x1875463014227328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581067.376126:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014227328:0@lo:400:kworker.0 00000100:00100000:2.0:1788581067.376266:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014227072:0@lo:400:kworker.0 00000100:00100000:2.0:1788581067.376298:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581067.376328:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014227584:0@lo:400:kworker.0 00000100:00100000:2.0:1788581067.376349:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581067.376374:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788581067.376379:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014226944:0@lo:400:kworker.0 00000100:00100000:2.0:1788581067.376406:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581067.376428:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3341:1875463014227456:0@lo:400:kworker.0 00000100:00100000:2.0:1788581067.376450:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581067.376476:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014227200 00000100:00100000:2.0:1788581067.376480:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014227200 00000100:00100000:2.0:1788581067.376508:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014227072 00000100:00100000:2.0:1788581067.376510:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014227072 00000100:00100000:2.0:1788581067.376538:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014227456 00000100:00100000:2.0:1788581067.376540:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014227456 00000100:00100000:2.0:1788581067.376554:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788581067.376560:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014227200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581067.376598:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014227200:12345-0@lo:400:kworker.0 Request processed in 37us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581067.376604:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788581067.376617:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788581067.376623:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014227072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581067.376654:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014227072:12345-0@lo:400:kworker.0 Request processed in 31us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581067.376660:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788581067.376672:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788581067.376678:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3341:x1875463014227456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581067.376705:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3341:x1875463014227456:12345-0@lo:400:kworker.0 Request processed in 28us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581067.376710:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788581067.376734:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3341:1875463014227456:0@lo:400:kworker.0 00000100:00100000:2.0:1788581067.376743:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014227072:0@lo:400:kworker.0 00000100:00100000:3.0:1788581067.376814:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014227584 00000100:00100000:3.0:1788581067.376819:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014227584 00000100:00100000:3.0:1788581067.376859:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788581067.376868:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014227584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581067.376910:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014227584:12345-0@lo:400:kworker.0 Request processed in 44us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581067.376916:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788581067.376945:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907f871180 x1875463014227584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581067.376963:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014227584:0@lo:400:kworker.0 00000100:00100000:0.0:1788581067.377051:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014226944 00000100:00100000:0.0:1788581067.377057:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014226944 00000100:00100000:0.0:1788581067.377095:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788581067.377103:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014226944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581067.377151:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014226944:12345-0@lo:400:kworker.0 Request processed in 50us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581067.377157:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:0.0:1788581067.377189:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581067.377194:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581067.377214:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014227200:0@lo:400:kworker.0 00000100:00100000:3.0:1788581067.377475:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014226944:0@lo:400:kworker.0 00010000:00010000:1.0:1788581067.825017:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581067.888423:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014227712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581067.888510:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581067.889037:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014227712 00000100:00100000:1.0:1788581067.889046:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014227712 00000100:00100000:1.0:1788581067.889106:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788581067.889117:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014227712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581067.889155:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581067.889215:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014227712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581067.889222:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788581067.889590:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190474c0700 x1875463014227712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581067.889611:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014227712:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788581068.720717:0:9390:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00010000:00010000:3.0:1788581068.847777:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581069.871766:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581069.935509:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014227840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581069.935607:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581069.935850:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014227840 00000100:00100000:1.0:1788581069.935858:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014227840 00000100:00100000:1.0:1788581069.935925:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788581069.935934:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014227840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581069.935989:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581069.936047:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014227840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581069.936069:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788581069.936113:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076316d80 x1875463014227840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581069.936130:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014227840:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788581069.936368:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788581070.898699:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581071.920441:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788581072.035480:0:9488:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00000100:00100000:2.0:1788581072.277475:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581072.277539:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581072.277632:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995321216 00000100:00100000:2.0:1788581072.277645:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995321216 00000100:00100000:0.0:1788581072.277795:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995321344 00000100:00100000:0.0:1788581072.277800:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995321344 00000100:00100000:0.0:1788581072.277851:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:0.0:1788581072.277863:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2373:x1875462995321344:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581072.277976:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2373:x1875462995321344:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 115us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581072.277985:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00080000:0.0:1788581072.278011:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581072.279015:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 201 00000100:00100000:2.0:1788581072.279046:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2372:x1875462995321216:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581072.279108:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2372:x1875462995321216:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 69us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581072.283851:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 201 00000100:00100000:2.0:1788581072.503920:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581072.503949:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014228224:0@lo:400:kworker.0 00000100:00100000:2.0:1788581072.504039:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581072.504130:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014228224 00000100:00100000:2.0:1788581072.504139:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014228224 00000100:00100000:2.0:1788581072.504209:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788581072.504218:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014228224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581072.504296:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014228224:12345-0@lo:400:kworker.0 Request processed in 79us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581072.504304:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788581072.504465:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581072.504503:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014228224:0@lo:400:kworker.0 00000100:00100000:2.0:1788581072.504618:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014228352:0@lo:400:kworker.0 00000100:00100000:2.0:1788581072.504649:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581072.504682:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014228352 00000100:00100000:2.0:1788581072.504686:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014228352 00000100:00100000:2.0:1788581072.505469:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788581072.505482:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014228352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581072.505617:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014228352:12345-0@lo:400:kworker.0 Request processed in 138us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581072.505625:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788581072.505657:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788581072.505685:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907f86dc00 x1875463014228352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581072.505698:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014228352:0@lo:400:kworker.0 00000100:00100000:3.0:1788581072.505843:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014228096:0@lo:400:kworker.0 00000100:00100000:3.0:1788581072.505901:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581072.505942:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581072.505950:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014227968:0@lo:400:kworker.0 00000100:00100000:3.0:1788581072.505982:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581072.506029:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014228096 00000100:00100000:3.0:1788581072.506035:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014228096 00000100:00100000:3.0:1788581072.506070:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788581072.506077:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014228096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581072.506114:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014228096:12345-0@lo:400:kworker.0 Request processed in 37us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581072.506120:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788581072.506148:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014227968 00000100:00100000:3.0:1788581072.506152:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014227968 00000100:00100000:3.0:1788581072.506173:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788581072.506178:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014227968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581072.506212:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014227968:12345-0@lo:400:kworker.0 Request processed in 33us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581072.506218:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788581072.506264:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014227968:0@lo:400:kworker.0 00000100:00100000:3.0:1788581072.506274:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014228096:0@lo:400:kworker.0 00000100:00100000:2.0:1788581072.506848:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014228480:0@lo:400:kworker.0 00000100:00100000:2.0:1788581072.506884:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581072.506919:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581072.506925:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014228608:0@lo:400:kworker.0 00000100:00100000:2.0:1788581072.506950:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581072.506978:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014228608 00000100:00100000:2.0:1788581072.506983:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014228608 00000100:00100000:2.0:1788581072.507021:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788581072.507029:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014228608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581072.507067:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014228608:12345-0@lo:400:kworker.0 Request processed in 39us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581072.507073:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788581072.507094:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014228480 00000100:00100000:2.0:1788581072.507097:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014228480 00000100:00100000:2.0:1788581072.507119:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788581072.507126:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014228480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581072.507153:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014228480:12345-0@lo:400:kworker.0 Request processed in 28us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581072.507159:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788581072.507174:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581072.507179:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788581072.507197:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907f86c000 x1875463014228608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581072.507224:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014228608:0@lo:400:kworker.0 00000100:00100000:2.0:1788581072.507235:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014228480:0@lo:400:kworker.0 00010000:00010000:2.0:1788581072.944987:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581073.008071:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581073.008104:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014228736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581073.008200:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581073.008837:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014228736 00000100:00100000:1.0:1788581073.008849:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014228736 00000100:00100000:1.0:1788581073.008975:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788581073.008987:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014228736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581073.009038:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581073.009111:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014228736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581073.009119:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788581073.009264:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907f86dc00 x1875463014228736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581073.009285:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014228736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788581073.968456:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788581074.193392:0:9536:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 00:04:31 EDT 2026 00010000:00010000:0.0:1788581074.992912:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581075.059921:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014228864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581075.060022:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581075.060344:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014228864 00000100:00100000:0.0:1788581075.060355:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014228864 00000100:00080000:2.0:1788581075.060482:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581075.061233:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788581075.061266:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014228864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581075.061313:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581075.061396:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014228864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581075.061404:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788581075.061463:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907f873800 x1875463014228864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581075.061485:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014228864:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788581076.022507:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581077.044370:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581077.379681:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581077.379725:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581077.379787:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995321472 00000100:00100000:0.0:1788581077.379798:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995321472 00000100:00100000:0.0:1788581077.379880:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 203 00000100:00100000:0.0:1788581077.379892:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2372:x1875462995321472:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581077.379986:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2372:x1875462995321472:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 96us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581077.379993:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 203 00000100:00100000:3.0:1788581077.380110:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995321600 00000100:00100000:3.0:1788581077.380114:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995321600 00000100:00100000:3.0:1788581077.380162:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 54 00000100:00100000:3.0:1788581077.380168:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2373:x1875462995321600:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581077.380196:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2373:x1875462995321600:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 29us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581077.380200:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 54 00000100:00080000:0.0:1788581077.380282:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581077.616149:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014229120:0@lo:400:kworker.0 00000100:00100000:1.0:1788581077.616264:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581077.616440:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014228992:0@lo:400:kworker.0 00000100:00100000:2.0:1788581077.616473:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581077.616520:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014229504:0@lo:400:kworker.0 00000100:00100000:2.0:1788581077.616545:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581077.616671:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014229632:0@lo:400:kworker.0 00000100:00100000:1.0:1788581077.616832:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581077.616877:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014229248:0@lo:400:kworker.0 00000100:00100000:1.0:1788581077.616927:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581077.616946:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581077.616950:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014229376:0@lo:400:kworker.0 00000100:00100000:1.0:1788581077.616965:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581077.616991:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014229120 00000100:00100000:1.0:1788581077.616998:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014229120 00000100:00100000:1.0:1788581077.617040:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014229504 00000100:00100000:1.0:1788581077.617042:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014229504 00000100:00100000:1.0:1788581077.617060:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014229248 00000100:00100000:1.0:1788581077.617061:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014229248 00000100:00100000:1.0:1788581077.617073:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788581077.617080:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014229120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581077.617139:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014229120:12345-0@lo:400:kworker.0 Request processed in 58us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581077.617147:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788581077.617163:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788581077.617167:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014229504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581077.617310:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014228992 00000100:00100000:3.0:1788581077.617314:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014228992 00000100:00100000:3.0:1788581077.617343:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788581077.617348:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014228992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581077.617517:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014229632 00000100:00100000:2.0:1788581077.617521:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014229632 00000100:00100000:2.0:1788581077.617544:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014229376 00000100:00100000:2.0:1788581077.617546:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014229376 00000100:00100000:2.0:1788581077.617556:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788581077.617560:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014229632:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788581077.617751:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788581077.617756:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581077.617758:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581077.626170:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014228992:12345-0@lo:400:kworker.0 Request processed in 8804us (9678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581077.626191:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788581077.627419:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014229632:12345-0@lo:400:kworker.0 Request processed in 9850us (10579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581077.627432:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788581077.627472:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788581077.627494:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014229376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581077.627564:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014229376:12345-0@lo:400:kworker.0 Request processed in 85us (10597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581077.627569:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788581077.628637:0:5878:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788581077.628645:0:5878:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788581077.629478:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014228992:0@lo:400:kworker.0 00000100:00100000:2.0:1788581077.629505:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014229504:0@lo:400:kworker.0 00000100:00100000:2.0:1788581077.629550:0:5876:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788581077.629560:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788581077.629570:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014229248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581077.629636:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014229248:12345-0@lo:400:kworker.0 Request processed in 70us (12709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581077.629641:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788581077.629686:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014229120:0@lo:400:kworker.0 00010000:00080000:2.0:1788581077.629701:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076316680 x1875463014229632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581077.629709:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014229632:0@lo:400:kworker.0 00010000:00080000:2.0:1788581077.633475:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076315c00 x1875463014229376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581077.633500:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014229376:0@lo:400:kworker.0 00000100:00100000:2.0:1788581077.633513:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014229248:0@lo:400:kworker.0 00000100:00100000:1.0:1788581077.637872:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014229504:12345-0@lo:400:kworker.0 Request processed in 20687us (21309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581077.637891:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00010000:1.0:1788581078.064636:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581078.128499:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581078.128529:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014229760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581078.128615:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581078.128855:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014229760 00000100:00100000:2.0:1788581078.128866:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014229760 00000100:00100000:2.0:1788581078.128936:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788581078.128950:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014229760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581078.129011:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581078.129072:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014229760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581078.129081:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788581078.129595:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907f86c380 x1875463014229760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581078.129622:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014229760:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788581079.088009:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581080.119073:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581080.180997:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014229888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581080.181068:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581080.182705:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014229888 00000100:00100000:3.0:1788581080.182718:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014229888 00000100:00100000:3.0:1788581080.182803:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788581080.182814:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014229888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581080.182859:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788581080.182929:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014229888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581080.182937:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788581080.182980:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076885880 x1875463014229888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581080.183000:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014229888:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788581080.183045:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788581081.143560:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581082.166829:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581082.510914:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581082.511049:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581082.511099:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995321728 00000100:00100000:0.0:1788581082.511112:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995321728 00000100:00100000:0.0:1788581082.511183:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 205 00000100:00100000:0.0:1788581082.511194:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2372:x1875462995321728:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581082.511309:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2372:x1875462995321728:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 116us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581082.511318:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 205 00000100:00100000:0.0:1788581082.511361:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995321856 00000100:00100000:0.0:1788581082.511365:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995321856 00000100:00100000:0.0:1788581082.511425:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 58 00000100:00100000:0.0:1788581082.511433:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2373:x1875462995321856:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581082.511466:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2373:x1875462995321856:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 35us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581082.511472:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 58 00000100:00080000:0.0:1788581082.511596:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581082.735589:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014230272:0@lo:400:kworker.0 00000100:00100000:1.0:1788581082.735704:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581082.735801:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581082.735809:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014230400:0@lo:400:kworker.0 00000100:00100000:1.0:1788581082.735838:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581082.735882:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014230400 00000100:00100000:1.0:1788581082.735893:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014230400 00000100:00100000:1.0:1788581082.735992:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788581082.736003:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014230400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581082.736083:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014230400:12345-0@lo:400:kworker.0 Request processed in 82us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581082.736091:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788581082.736119:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788581082.736154:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190768b4a80 x1875463014230400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581082.736170:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014230400:0@lo:400:kworker.0 00000100:00100000:3.0:1788581082.736482:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014230144:0@lo:400:kworker.0 00000100:00100000:3.0:1788581082.736524:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581082.736545:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014230656:0@lo:400:kworker.0 00000100:00100000:3.0:1788581082.736570:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581082.736589:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788581082.736595:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014230016:0@lo:400:kworker.0 00000100:00100000:3.0:1788581082.736638:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581082.736665:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3341:1875463014230528:0@lo:400:kworker.0 00000100:00100000:3.0:1788581082.736687:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581082.736717:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014230272 00000100:00100000:3.0:1788581082.736722:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014230272 00000100:00100000:3.0:1788581082.736786:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014230144 00000100:00100000:3.0:1788581082.736789:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014230144 00000100:00100000:3.0:1788581082.736803:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014230528 00000100:00100000:3.0:1788581082.736805:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014230528 00000100:00100000:3.0:1788581082.736820:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788581082.736826:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014230272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581082.736867:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014230272:12345-0@lo:400:kworker.0 Request processed in 41us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581082.736885:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788581082.736903:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788581082.736909:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014230144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581082.736941:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014230144:12345-0@lo:400:kworker.0 Request processed in 31us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581082.736946:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788581082.736957:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788581082.736962:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3341:x1875463014230528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581082.736987:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3341:x1875463014230528:12345-0@lo:400:kworker.0 Request processed in 24us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581082.736992:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788581082.737010:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014230016 00000100:00100000:3.0:1788581082.737014:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014230016 00000100:00100000:3.0:1788581082.737037:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788581082.737043:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014230016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581082.737279:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014230016:12345-0@lo:400:kworker.0 Request processed in 235us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581082.737287:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788581082.737345:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014230016:0@lo:400:kworker.0 00000100:00100000:3.0:1788581082.737360:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3341:1875463014230528:0@lo:400:kworker.0 00000100:00100000:3.0:1788581082.737371:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014230144:0@lo:400:kworker.0 00000100:00100000:2.0:1788581082.737575:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014230656 00000100:00100000:2.0:1788581082.737581:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014230656 00000100:00100000:2.0:1788581082.737643:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788581082.737653:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014230656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581082.737702:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014230656:12345-0@lo:400:kworker.0 Request processed in 52us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581082.737709:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788581082.737759:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190768b6a00 x1875463014230656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581082.737771:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014230656:0@lo:400:kworker.0 00000100:00080000:1.0:1788581082.737984:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788581082.737991:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581082.738021:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014230272:0@lo:400:kworker.0 00010000:00010000:1.0:1788581083.183922:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581083.247738:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581083.247785:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014230784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581083.247919:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581083.248181:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014230784 00000100:00100000:2.0:1788581083.248193:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014230784 00000100:00100000:2.0:1788581083.248296:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788581083.248309:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014230784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581083.248354:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581083.248420:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014230784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581083.248428:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788581083.248745:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907f86d180 x1875463014230784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581083.248775:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014230784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788581084.212068:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581085.231746:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581085.297814:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581085.297839:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014230912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581085.297912:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581085.297981:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014230912 00000100:00100000:3.0:1788581085.297989:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014230912 00000100:00100000:3.0:1788581085.298049:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788581085.298059:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014230912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581085.298094:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788581085.298140:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014230912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581085.298147:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788581085.298168:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788581085.298198:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076884a80 x1875463014230912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581085.298219:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014230912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788581086.263470:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581087.285621:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581087.630022:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581087.630073:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581087.630173:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995321984 00000100:00100000:1.0:1788581087.630184:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995321984 00000100:00100000:1.0:1788581087.630287:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 207 00000100:00100000:1.0:1788581087.630299:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2375:x1875462995321984:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581087.630375:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2375:x1875462995321984:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 78us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581087.630383:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 207 00000100:00100000:3.0:1788581087.632358:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995322112 00000100:00100000:3.0:1788581087.632371:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995322112 00000100:00100000:3.0:1788581087.632452:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 62 00000100:00100000:3.0:1788581087.632462:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2375:x1875462995322112:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581087.632542:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2375:x1875462995322112:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 81us (2467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581087.632563:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 62 00000100:00080000:2.0:1788581087.633156:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581087.855468:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581087.855493:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014231296:0@lo:400:kworker.0 00000100:00100000:1.0:1788581087.855565:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581087.855657:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014231424:0@lo:400:kworker.0 00000100:00100000:3.0:1788581087.855815:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014231040:0@lo:400:kworker.0 00000100:00100000:3.0:1788581087.855854:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581087.855882:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581087.855888:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014231168:0@lo:400:kworker.0 00000100:00100000:3.0:1788581087.855911:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581087.855945:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014231296 00000100:00100000:3.0:1788581087.855952:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014231296 00000100:00100000:3.0:1788581087.856007:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014231168 00000100:00100000:3.0:1788581087.856011:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014231168 00000100:00100000:3.0:1788581087.856030:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788581087.856039:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014231296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581087.856102:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014231296:12345-0@lo:400:kworker.0 Request processed in 64us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581087.856109:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788581087.856127:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788581087.856133:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014231168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581087.856163:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014231168:12345-0@lo:400:kworker.0 Request processed in 30us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581087.856170:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788581087.856188:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014231040 00000100:00100000:3.0:1788581087.856191:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014231040 00000100:00100000:3.0:1788581087.856214:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788581087.856220:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014231040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581087.856283:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014231040:12345-0@lo:400:kworker.0 Request processed in 62us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581087.856297:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:3.0:1788581087.856326:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581087.856364:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014231168:0@lo:400:kworker.0 00000100:00100000:3.0:1788581087.856373:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014231040:0@lo:400:kworker.0 00000100:00100000:1.0:1788581087.856556:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581087.856597:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014231296:0@lo:400:kworker.0 00000100:00100000:0.0:1788581087.856669:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014231552:0@lo:400:kworker.0 00000100:00100000:0.0:1788581087.856712:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581087.856779:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014231424 00000100:00100000:3.0:1788581087.856783:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014231424 00000100:00100000:3.0:1788581087.856821:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788581087.856829:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014231424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581087.856869:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014231424:12345-0@lo:400:kworker.0 Request processed in 40us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581087.856875:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788581087.856894:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788581087.856911:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190768b4000 x1875463014231424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581087.856922:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014231424:0@lo:400:kworker.0 00000100:00100000:0.0:1788581087.862211:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581087.862233:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014231680:0@lo:400:kworker.0 00000100:00100000:0.0:1788581087.862453:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581087.862690:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014231552 00000100:00100000:0.0:1788581087.863854:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014231552 00000100:00100000:0.0:1788581087.863936:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788581087.863946:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014231552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581087.864036:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014231552:12345-0@lo:400:kworker.0 Request processed in 92us (7323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581087.864044:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788581087.864192:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014231552:0@lo:400:kworker.0 00000100:00080000:1.0:1788581087.866303:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581087.868161:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014231680 00000100:00100000:3.0:1788581087.868179:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014231680 00000100:00100000:3.0:1788581087.868280:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788581087.868292:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014231680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581087.868392:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014231680:12345-0@lo:400:kworker.0 Request processed in 102us (5938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581087.868399:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788581087.868543:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788581087.868907:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190768b6680 x1875463014231680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581087.868924:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014231680:0@lo:400:kworker.0 00010000:00010000:2.0:1788581088.307290:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581088.376368:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581088.376391:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014231808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581088.376462:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581088.377376:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014231808 00000100:00100000:2.0:1788581088.377386:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014231808 00000100:00100000:2.0:1788581088.377449:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788581088.377459:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014231808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581088.377493:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581088.377548:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014231808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581088.377555:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788581088.377633:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907f86ed80 x1875463014231808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581088.377679:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014231808:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788581089.327527:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581090.352803:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581090.416949:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581090.416979:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014231936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581090.417075:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581090.417419:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014231936 00000100:00100000:2.0:1788581090.417428:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014231936 00000100:00100000:2.0:1788581090.417557:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788581090.417569:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f872a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014231936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581090.417619:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581090.417668:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f872a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014231936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581090.417675:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788581090.417763:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788581090.418585:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076886a00 x1875463014231936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581090.418623:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014231936:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788581091.377459:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581092.400874:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788581092.549119:0:10168:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 00:04:50 (1788581090) === 00000100:00100000:0.0:1788581092.746501:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581092.746597:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581092.746630:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995322240 00000100:00100000:0.0:1788581092.746641:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995322240 00000100:00100000:0.0:1788581092.746696:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 209 00000100:00100000:0.0:1788581092.746707:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2372:x1875462995322240:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581092.746779:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2372:x1875462995322240:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 74us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581092.746787:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 209 00000100:00100000:0.0:1788581092.746830:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995322368 00000100:00100000:0.0:1788581092.746836:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995322368 00000100:00100000:0.0:1788581092.746875:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 66 00000100:00100000:0.0:1788581092.746882:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2372:x1875462995322368:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581092.746916:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2372:x1875462995322368:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 35us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581092.746923:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 66 00000100:00080000:0.0:1788581092.747061:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581092.975701:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581092.975724:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014232320:0@lo:400:kworker.0 00000100:00100000:1.0:1788581092.975792:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581092.975869:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014232448:0@lo:400:kworker.0 00000100:00100000:1.0:1788581092.975891:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581092.976001:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014232448 00000100:00100000:3.0:1788581092.976009:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014232448 00000100:00100000:3.0:1788581092.976069:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788581092.976078:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014232448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581092.976130:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014232448:12345-0@lo:400:kworker.0 Request processed in 53us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581092.976137:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788581092.976173:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190768b5f80 x1875463014232448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581092.976186:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014232448:0@lo:400:kworker.0 00000100:00100000:0.0:1788581092.976303:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014232064:0@lo:400:kworker.0 00000100:00100000:0.0:1788581092.976336:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581092.976366:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014232576:0@lo:400:kworker.0 00000100:00100000:0.0:1788581092.976383:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581092.976398:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788581092.976402:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014232192:0@lo:400:kworker.0 00000100:00100000:0.0:1788581092.976418:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581092.976433:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014232704:0@lo:400:kworker.0 00000100:00100000:0.0:1788581092.976449:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581092.976473:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014232320 00000100:00100000:0.0:1788581092.976477:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014232320 00000100:00100000:0.0:1788581092.976502:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014232576 00000100:00100000:0.0:1788581092.976504:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014232576 00000100:00100000:0.0:1788581092.976514:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014232192 00000100:00100000:0.0:1788581092.976516:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014232192 00000100:00100000:0.0:1788581092.976527:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788581092.976532:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014232320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581092.976576:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014232320:12345-0@lo:400:kworker.0 Request processed in 43us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581092.976597:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788581092.976609:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788581092.976614:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014232576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581092.976644:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014232576:12345-0@lo:400:kworker.0 Request processed in 30us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581092.976650:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788581092.976660:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788581092.976665:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014232192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581092.976687:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014232192:12345-0@lo:400:kworker.0 Request processed in 22us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581092.976692:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788581092.976721:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014232704 00000100:00100000:0.0:1788581092.976724:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014232704 00000100:00100000:0.0:1788581092.976743:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788581092.976748:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014232704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581092.976775:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014232704:12345-0@lo:400:kworker.0 Request processed in 27us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581092.976780:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788581092.976804:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014232192:0@lo:400:kworker.0 00010000:00080000:0.0:1788581092.976814:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190768b7800 x1875463014232704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581092.976822:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014232704:0@lo:400:kworker.0 00000100:00100000:0.0:1788581092.976830:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014232576:0@lo:400:kworker.0 00000100:00100000:3.0:1788581092.976992:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014232064 00000100:00100000:3.0:1788581092.976996:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014232064 00000100:00100000:3.0:1788581092.977028:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788581092.977034:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014232064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581092.977068:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014232064:12345-0@lo:400:kworker.0 Request processed in 34us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581092.977073:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788581092.977110:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014232064:0@lo:400:kworker.0 00000100:00100000:3.0:1788581092.977129:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014232320:0@lo:400:kworker.0 00000100:00080000:1.0:1788581092.977226:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788581092.977231:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581092.977233:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581093.152223:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581093.152466:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995322496 00000100:00100000:0.0:1788581093.152490:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995322496 00000100:00100000:0.0:1788581093.152562:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 211 00000100:00100000:0.0:1788581093.152574:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:8145:x1875462995322496:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788581093.152601:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581093.152620:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91907bc23c00/0xf54e3944c2a70064 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8f5b expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581093.152652:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91907bc23c00/0xf54e3944c2a70064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f5b expref: 11 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581093.152664:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91907bc23c00/0xf54e3944c2a70064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f5b expref: 11 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581093.152673:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc23c00, rc 0) 00000100:00100000:0.0:1788581093.152743:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+11:8145:x1875462995322496:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 171us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581093.152750:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 211 00000100:00100000:0.0:1788581093.161051:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581093.161190:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995322624 00000100:00100000:2.0:1788581093.161200:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995322624 00000100:00100000:2.0:1788581093.161283:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 212 00000100:00100000:2.0:1788581093.161294:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+11:8145:x1875462995322624:12345-192.168.201.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788581093.161623:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+11:8145:x1875462995322624:12345-192.168.201.13@tcp:501:mount.lustre.0 Request processed in 329us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581093.161632:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 212 00000100:00100000:2.0:1788581093.172850:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581093.172962:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995322752 00000100:00100000:3.0:1788581093.172983:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995322752 00000100:00100000:3.0:1788581093.173039:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 213 00000100:00100000:3.0:1788581093.173049:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+11:8145:x1875462995322752:12345-192.168.201.13@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788581093.173322:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+11:8145:x1875462995322752:12345-192.168.201.13@tcp:503:mount.lustre.0 Request processed in 273us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581093.173330:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 213 00000100:00100000:3.0:1788581093.184315:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581093.185021:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995322880 00000100:00100000:0.0:1788581093.185031:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995322880 00000100:00100000:0.0:1788581093.185088:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 214 00000100:00100000:0.0:1788581093.185098:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+11:8149:x1875462995322880:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788581093.185417:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+11:8149:x1875462995322880:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 319us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581093.185425:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 214 00000100:00100000:0.0:1788581093.208020:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581093.208173:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995323008 00000100:00100000:2.0:1788581093.208183:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995323008 00000100:00100000:2.0:1788581093.208279:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 215 00000100:00100000:2.0:1788581093.208291:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+11:8149:x1875462995323008:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788581093.208723:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+11:8149:x1875462995323008:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 432us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581093.208732:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 215 00000100:00100000:1.0:1788581093.222880:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581093.223173:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995323136 00000100:00100000:0.0:1788581093.223198:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995323136 00000100:00100000:0.0:1788581093.223288:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 216 00000100:00100000:0.0:1788581093.223299:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+11:8145:x1875462995323136:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788581093.223317:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581093.223336:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91907bc22c00/0xf54e3944c2a7006b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8f85 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581093.223365:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91907bc22c00/0xf54e3944c2a7006b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f85 expref: 12 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581093.223376:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91907bc22c00/0xf54e3944c2a7006b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f85 expref: 12 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581093.223385:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22c00, rc 0) 00000100:00100000:0.0:1788581093.223489:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:8145:x1875462995323136:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 192us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581093.223496:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 216 00000100:00100000:3.0:1788581093.233021:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581093.233176:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995323264 00000100:00100000:2.0:1788581093.233187:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995323264 00000100:00100000:2.0:1788581093.233274:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 217 00000100:00100000:2.0:1788581093.233285:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:8145:x1875462995323264:12345-192.168.201.13@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788581093.233311:0:5869:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788581093.233336:0:5869:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788581093.233340:0:5869:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788581093.233344:0:5869:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788581093.233346:0:5869:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788581093.236155:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:8145:x1875462995323264:12345-192.168.201.13@tcp:256:mount.lustre.0 Request processed in 2863us (3133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581093.236170:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 217 00000100:00100000:1.0:1788581093.240695:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581093.240840:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995323392 00000100:00100000:3.0:1788581093.240851:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995323392 00000100:00100000:3.0:1788581093.240913:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 218 00000100:00100000:3.0:1788581093.240923:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:8145:x1875462995323392:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788581093.240940:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581093.240958:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821cee00/0xf54e3944c2a70072 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8f8c expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581093.240996:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821cee00/0xf54e3944c2a70072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f8c expref: 13 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581093.241008:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821cee00/0xf54e3944c2a70072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f8c expref: 13 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581093.241017:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cee00, rc 0) 00000100:00100000:3.0:1788581093.241078:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:8145:x1875462995323392:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 157us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581093.241085:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 218 00000100:00100000:3.0:1788581093.244353:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581093.244474:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995323520 00000100:00100000:2.0:1788581093.244485:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995323520 00000100:00100000:2.0:1788581093.244542:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 219 00000100:00100000:2.0:1788581093.244562:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:8145:x1875462995323520:12345-192.168.201.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788581093.244885:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:8145:x1875462995323520:12345-192.168.201.13@tcp:501:mount.lustre.0 Request processed in 332us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581093.244893:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 219 00000100:00100000:1.0:1788581093.248019:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581093.248376:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995323648 00000100:00100000:0.0:1788581093.248386:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995323648 00000100:00100000:0.0:1788581093.248799:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 220 00000100:00100000:0.0:1788581093.248812:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:8145:x1875462995323648:12345-192.168.201.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788581093.249202:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:8145:x1875462995323648:12345-192.168.201.13@tcp:503:mount.lustre.0 Request processed in 392us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581093.249211:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 220 00000100:00100000:3.0:1788581093.253215:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581093.253372:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995323776 00000100:00100000:0.0:1788581093.253383:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995323776 00000100:00100000:0.0:1788581093.253443:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 221 00000100:00100000:0.0:1788581093.253455:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:8152:x1875462995323776:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788581093.253952:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:8152:x1875462995323776:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 496us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581093.253970:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 221 00000100:00100000:3.0:1788581093.257754:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581093.257828:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995323904 00000100:00100000:0.0:1788581093.257838:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995323904 00000100:00100000:0.0:1788581093.257901:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 222 00000100:00100000:0.0:1788581093.257911:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:8152:x1875462995323904:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788581093.258165:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:8152:x1875462995323904:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 254us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581093.258174:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 222 00000100:00100000:1.0:1788581093.268991:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581093.269090:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995324032 00000100:00100000:0.0:1788581093.269101:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995324032 00000100:00100000:0.0:1788581093.269156:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:0.0:1788581093.269165:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2371:x1875462995324032:12345-192.168.201.13@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788581093.269196:0:5878:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0cbb0a85-7fe6-4f80-9c92-71853a6f2376@192.168.201.13@tcp t0 exp 0000000000000000 cur 309 last 0 00000020:00000080:0.0:1788581093.269232:0:5878:0:(genops.c:1385:class_connect()) connect: client 0cbb0a85-7fe6-4f80-9c92-71853a6f2376, cookie 0xf54e3944c2a70079 00000004:00100000:0.0:1788581093.269289:0:5878:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788581093.269550:0:5878:0:(import.c:65:import_set_state_nolock()) ffff9190779b6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581093.269629:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:2371:x1875462995324032:12345-192.168.201.13@tcp:38:mount.lustre.0 Request processed in 463us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581093.269638:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:2.0:1788581093.281350:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581093.281395:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581093.281487:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995324288 00000100:00100000:0.0:1788581093.281498:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995324288 00000100:00100000:0.0:1788581093.281594:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995324160 00000100:00100000:0.0:1788581093.281598:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995324160 00000100:00100000:0.0:1788581093.281641:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:0.0:1788581093.281651:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+7:8145:x1875462995324288:12345-192.168.201.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788581093.281695:0:5876:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788581093.281824:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+7:8145:x1875462995324288:12345-192.168.201.13@tcp:41:mount.lustre.0 Request processed in 173us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581093.281832:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:0.0:1788581093.281849:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:0.0:1788581093.281855:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:0:x1875462995324160:12345-192.168.201.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788581093.281866:0:5876:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788581093.281886:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:0:x1875462995324160:12345-192.168.201.13@tcp:41:mount.lustre.0 Request processed in 32us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581093.281892:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00080000:1.0:1788581093.281988:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581093.284830:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581093.285685:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995324416 00000100:00100000:0.0:1788581093.285700:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995324416 00000100:00100000:0.0:1788581093.285772:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:0.0:1788581093.285784:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:8145:x1875462995324416:12345-192.168.201.13@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788581093.285938:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:8145:x1875462995324416:12345-192.168.201.13@tcp:40:mount.lustre.0 Request processed in 155us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581093.285946:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:1.0:1788581093.295875:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581093.295988:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581093.296018:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581093.296182:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995324544 00000100:00100000:0.0:1788581093.296194:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995324544 00000100:00100000:0.0:1788581093.296270:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995324672 00000100:00100000:0.0:1788581093.296273:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995324672 00000100:00100000:0.0:1788581093.296289:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:0.0:1788581093.296298:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2371:x1875462995324544:12345-192.168.201.13@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788581093.296332:0:6725:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0cbb0a85-7fe6-4f80-9c92-71853a6f2376@192.168.201.13@tcp t0 exp 0000000000000000 cur 309 last 0 00000020:00000080:0.0:1788581093.296374:0:6725:0:(genops.c:1385:class_connect()) connect: client 0cbb0a85-7fe6-4f80-9c92-71853a6f2376, cookie 0xf54e3944c2a70080 00002000:00100000:0.0:1788581093.296386:0:6725:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0cbb0a85-7fe6-4f80-9c92-71853a6f2376/ffff9190779b2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788581093.296412:0:6725:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788581093.296688:0:6725:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788581093.296719:0:6725:0:(import.c:65:import_set_state_nolock()) ffff9190779b7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581093.296791:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:2371:x1875462995324544:12345-192.168.201.13@tcp:8:mount.lustre.0 Request processed in 493us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581093.296799:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:0.0:1788581093.296820:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:0.0:1788581093.296824:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2371:x1875462995324672:12345-192.168.201.13@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788581093.296840:0:6725:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0cbb0a85-7fe6-4f80-9c92-71853a6f2376@192.168.201.13@tcp t0 exp 0000000000000000 cur 309 last 0 00000020:00000080:0.0:1788581093.296857:0:6725:0:(genops.c:1385:class_connect()) connect: client 0cbb0a85-7fe6-4f80-9c92-71853a6f2376, cookie 0xf54e3944c2a70087 00002000:00100000:0.0:1788581093.296862:0:6725:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0cbb0a85-7fe6-4f80-9c92-71853a6f2376/ffff9190779b3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788581093.296877:0:6725:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788581093.297088:0:6725:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788581093.297105:0:6725:0:(import.c:65:import_set_state_nolock()) ffff9190779b4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581093.297130:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:2371:x1875462995324672:12345-192.168.201.13@tcp:8:mount.lustre.0 Request processed in 303us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581093.297137:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:2.0:1788581093.298756:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995324800 00000100:00100000:2.0:1788581093.298770:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995324800 00000100:00100000:2.0:1788581093.298822:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:2.0:1788581093.298833:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:8145:x1875462995324800:12345-192.168.201.13@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788581093.298910:0:5879:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788581093.299034:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:8145:x1875462995324800:12345-192.168.201.13@tcp:33:mount.lustre.0 Request processed in 202us (3171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581093.299041:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 1 00010000:00010000:3.0:1788581093.424630:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581093.487910:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014232832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581093.487986:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581093.488204:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014232832 00000100:00100000:0.0:1788581093.488214:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014232832 00000100:00100000:0.0:1788581093.488319:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788581093.488330:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014232832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788581093.488353:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581093.496520:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014232832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8180us (8521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581093.496537:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788581093.497045:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907f86ca80 x1875463014232832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581093.497069:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014232832:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788581094.451819:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581095.471763:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581095.538988:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581095.539026:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014232960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581095.539128:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581095.539660:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014232960 00000100:00100000:2.0:1788581095.539678:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014232960 00000100:00100000:2.0:1788581095.539829:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788581095.539842:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014232960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581095.539886:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581095.539982:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014232960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581095.539990:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788581095.540053:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076886300 x1875463014232960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581095.540074:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014232960:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788581095.540914:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788581096.495386:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788581096.630885:0:7696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0cbb0a85-7fe6-4f80-9c92-71853a6f2376 00000001:00100000:0.0:1788581097.114758:0:5899:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0cbb0a85-7fe6-4f80-9c92-71853a6f2376 00000001:00100000:3.0:1788581097.127001:0:6750:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0cbb0a85-7fe6-4f80-9c92-71853a6f2376 00010000:00010000:0.0:1788581097.519532:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581098.096517:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014233088:0@lo:400:kworker.0 00000100:00100000:1.0:1788581098.096546:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014233472:0@lo:400:kworker.0 00000100:00100000:0.0:1788581098.096650:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014233344:0@lo:400:kworker.0 00000100:00100000:2.0:1788581098.096936:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014233216:0@lo:400:kworker.0 00000100:00100000:3.0:1788581098.105952:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581098.106038:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014233600:0@lo:400:kworker.0 00000100:00100000:3.0:1788581098.106087:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581098.106226:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014233600 00000100:00100000:3.0:1788581098.106236:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014233600 00000100:00100000:3.0:1788581098.106307:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788581098.107862:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014233600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581098.107976:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014233600:12345-0@lo:400:kworker.0 Request processed in 1659us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581098.107985:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1788581098.108021:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581098.108063:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014233600:0@lo:400:kworker.0 00000100:00100000:1.0:1788581098.109568:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581098.109675:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014233088 00000100:00100000:1.0:1788581098.109684:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014233088 00000100:00100000:0.0:1788581098.109876:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581098.109925:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014233472 00000100:00100000:0.0:1788581098.109930:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014233472 00000100:00100000:0.0:1788581098.109974:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788581098.109984:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014233472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581098.110066:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788581098.110075:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014233088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581098.110252:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581098.110279:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014233728:0@lo:400:kworker.0 00000100:00100000:2.0:1788581098.110318:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581098.110364:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014233344 00000100:00100000:2.0:1788581098.110368:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014233344 00000100:00100000:2.0:1788581098.110395:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014233216 00000100:00100000:2.0:1788581098.110397:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014233216 00000100:00100000:2.0:1788581098.110418:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788581098.110424:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014233344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581098.110598:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014233088:12345-0@lo:400:kworker.0 Request processed in 524us (4655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581098.110606:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788581098.110640:0:6722:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788581098.110649:0:6722:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788581098.110980:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014233472:12345-0@lo:400:kworker.0 Request processed in 997us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581098.111052:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788581098.111067:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014233728 00000100:00100000:0.0:1788581098.111070:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014233728 00000100:00100000:0.0:1788581098.111090:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788581098.111258:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190768b5f80 x1875463014233472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581098.111274:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014233472:0@lo:400:kworker.0 00000100:00100000:1.0:1788581098.111308:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014233088:0@lo:400:kworker.0 00000100:00100000:1.0:1788581098.111419:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788581098.111530:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014233728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581098.111580:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014233728:12345-0@lo:400:kworker.0 Request processed in 483us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581098.111587:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788581098.111616:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581098.111621:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788581098.111622:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581098.111836:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014233344:12345-0@lo:400:kworker.0 Request processed in 1411us (1959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581098.111842:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1788581098.111880:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c61f800 x1875463014233728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581098.111891:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014233728:0@lo:400:kworker.0 00000100:00100000:0.0:1788581098.112328:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014233344:0@lo:400:kworker.0 00000100:00100000:1.0:1788581098.112416:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014233216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581098.112605:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014233216:12345-0@lo:400:kworker.0 Request processed in 1178us (2364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581098.112612:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788581098.112689:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014233216:0@lo:400:kworker.0 00000100:00100000:0.0:1788581098.376002:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581098.376051:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581098.376087:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581098.376150:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995325440 00000100:00100000:0.0:1788581098.376150:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581098.376160:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995325440 00000100:00100000:0.0:1788581098.376177:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00080000:0.0:1788581098.376193:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581098.376217:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995325312 00000100:00100000:3.0:1788581098.376220:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995325312 00000100:00100000:0.0:1788581098.376234:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 40 00000100:00100000:0.0:1788581098.376269:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995325440:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581098.376276:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:3.0:1788581098.376283:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995325312:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581098.376362:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995325184 00000100:00100000:2.0:1788581098.376368:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995325184 00000100:00100000:2.0:1788581098.376399:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995325056 00000100:00100000:2.0:1788581098.376402:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995325056 00000100:00100000:2.0:1788581098.376424:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 73 00000100:00100000:2.0:1788581098.376431:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995325184:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581098.376516:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995324928 00000100:00100000:1.0:1788581098.376520:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995324928 00000100:00100000:1.0:1788581098.376547:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 224 00000100:00100000:1.0:1788581098.376554:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995324928:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581098.376622:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995325440:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 379us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581098.376629:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 40 00000100:00080000:0.0:1788581098.376651:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788581098.376654:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581098.376704:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 74 00000100:00100000:0.0:1788581098.376711:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995325056:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581098.377494:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995325312:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 1205us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581098.377505:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:2.0:1788581098.378657:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995325184:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 2218us (2597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581098.378953:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 73 00000100:00100000:1.0:1788581098.380199:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995324928:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 3637us (4200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581098.380222:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 224 00000100:00100000:0.0:1788581098.381216:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995325056:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 4500us (5060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581098.381226:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 74 00010000:00010000:3.0:1788581098.543554:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581098.608630:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581098.608656:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014233856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581098.608743:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581098.609110:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014233856 00000100:00100000:2.0:1788581098.609119:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014233856 00000100:00100000:2.0:1788581098.609176:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788581098.609187:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014233856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581098.609223:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581098.609316:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014233856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581098.609323:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788581098.609363:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907f86ed80 x1875463014233856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581098.609382:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014233856:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788581099.198074:0:10367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788581099.567420:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581100.595169:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581100.655404:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014233984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581100.655480:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581100.655545:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014233984 00000100:00100000:3.0:1788581100.655552:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014233984 00000100:00100000:3.0:1788581100.655602:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788581100.655611:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014233984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581100.655642:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788581100.655683:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014233984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581100.655689:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788581100.655727:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076887b80 x1875463014233984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581100.655744:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014233984:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788581100.656461:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788581101.615587:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581102.646132:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581103.216947:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014234240:0@lo:400:kworker.0 00000100:00100000:0.0:1788581103.217111:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014234112:0@lo:400:kworker.0 00000100:00100000:0.0:1788581103.217186:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581103.217264:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014234624:0@lo:400:kworker.0 00000100:00100000:0.0:1788581103.217294:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581103.217334:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014234368:0@lo:400:kworker.0 00000100:00100000:0.0:1788581103.217358:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581103.217378:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581103.217411:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014234496:0@lo:400:kworker.0 00000100:00100000:0.0:1788581103.217441:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581103.220497:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014234112 00000100:00100000:0.0:1788581103.220511:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014234112 00000100:00100000:0.0:1788581103.220565:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788581103.220576:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014234112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581103.225694:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581103.225753:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014234752:0@lo:400:kworker.0 00000100:00100000:1.0:1788581103.226039:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014234624 00000100:00100000:1.0:1788581103.226049:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014234624 00000100:00100000:1.0:1788581103.226104:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014234368 00000100:00100000:1.0:1788581103.226108:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014234368 00000100:00100000:1.0:1788581103.226122:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014234240 00000100:00100000:1.0:1788581103.226124:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014234240 00000100:00100000:1.0:1788581103.226138:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788581103.226145:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014234624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581103.226211:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581103.230224:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014234112:12345-0@lo:400:kworker.0 Request processed in 9641us (13028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581103.230239:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788581103.230316:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788581103.230329:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014234368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581103.230397:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014234368:12345-0@lo:400:kworker.0 Request processed in 72us (13037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581103.230403:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788581103.230423:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788581103.230430:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014234240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581103.230470:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014234240:12345-0@lo:400:kworker.0 Request processed in 41us (4783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581103.230475:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788581103.230511:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014234496 00000100:00100000:0.0:1788581103.230518:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014234496 00000100:00100000:0.0:1788581103.230553:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014234752 00000100:00100000:0.0:1788581103.230724:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014234752 00000100:00100000:0.0:1788581103.230754:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788581103.230762:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904a0f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014234496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581103.230921:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904a0f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014234496:12345-0@lo:400:kworker.0 Request processed in 160us (13478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581103.230929:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788581103.231208:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788581103.231216:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014234752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581103.231273:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014234752:12345-0@lo:400:kworker.0 Request processed in 58us (5061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581103.231280:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788581103.231331:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014234112:0@lo:400:kworker.0 00010000:00080000:0.0:1788581103.231370:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907f86dc00 x1875463014234496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581103.231394:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014234496:0@lo:400:kworker.0 00000100:00100000:0.0:1788581103.231410:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014234368:0@lo:400:kworker.0 00000100:00100000:1.0:1788581103.233778:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014234624:12345-0@lo:400:kworker.0 Request processed in 7626us (16476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581103.233807:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788581103.233851:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788581103.233856:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581103.233859:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581103.233912:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014234624:0@lo:400:kworker.0 00010000:00080000:2.0:1788581103.237950:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907f86ea00 x1875463014234752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581103.238107:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014234752:0@lo:400:kworker.0 00000100:00100000:2.0:1788581103.238146:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014234240:0@lo:400:kworker.0 00000100:00100000:2.0:1788581103.497287:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581103.497316:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581103.497342:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581103.497359:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581103.497397:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581103.497551:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995325952 00000100:00100000:3.0:1788581103.497561:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995325952 00000100:00100000:1.0:1788581103.497736:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995325568 00000100:00100000:1.0:1788581103.497741:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995325568 00000100:00100000:0.0:1788581103.497950:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995325696 00000100:00100000:0.0:1788581103.497967:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995325696 00000100:00100000:1.0:1788581103.498005:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 226 00000100:00100000:1.0:1788581103.498016:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2373:x1875462995325568:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581103.498087:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2373:x1875462995325568:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 73us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581103.498094:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 226 00000100:00100000:3.0:1788581103.499474:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995326080 00000100:00100000:3.0:1788581103.499484:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995326080 00000100:00100000:0.0:1788581103.502893:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995325824 00000100:00100000:0.0:1788581103.502906:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995325824 00000100:00100000:0.0:1788581103.502943:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 78 00000100:00100000:0.0:1788581103.502965:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2373:x1875462995325696:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581103.503049:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2373:x1875462995325696:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 95us (5770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581103.503067:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 78 00000100:00100000:0.0:1788581103.503083:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 79 00000100:00100000:0.0:1788581103.503088:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2373:x1875462995325824:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581103.503126:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2373:x1875462995325824:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 38us (5766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581103.503133:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 79 00000100:00100000:0.0:1788581103.503165:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:0.0:1788581103.503174:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2373:x1875462995325952:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581103.503199:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2373:x1875462995325952:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 27us (5882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581103.503206:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:3.0:1788581103.513581:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:3.0:1788581103.514085:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2373:x1875462995326080:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581103.514276:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2373:x1875462995326080:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 199us (16876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581103.514284:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00080000:2.0:1788581103.517370:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581103.523222:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788581103.523231:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788581103.666768:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581103.727529:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581103.727554:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014234880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581103.727623:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581103.727896:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014234880 00000100:00100000:2.0:1788581103.727907:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014234880 00000100:00100000:2.0:1788581103.727971:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788581103.727981:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014234880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581103.728033:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581103.728077:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014234880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581103.728085:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788581103.728184:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076315880 x1875463014234880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581103.728202:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014234880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788581104.693322:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581105.711513:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581105.775564:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014235008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581105.775642:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581105.775784:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014235008 00000100:00100000:0.0:1788581105.775793:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014235008 00000100:00100000:0.0:1788581105.775859:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788581105.775870:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014235008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581105.775908:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788581105.776863:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581105.779503:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014235008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3624us (3849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581105.779519:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788581105.780166:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076884e00 x1875463014235008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581105.780193:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014235008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788581106.736918:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581107.759390:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581108.336429:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014235264:0@lo:400:kworker.0 00000100:00100000:3.0:1788581108.336528:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581108.336601:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014235776:0@lo:400:kworker.0 00000100:00100000:3.0:1788581108.336628:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581108.336660:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788581108.336666:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014235136:0@lo:400:kworker.0 00000100:00100000:3.0:1788581108.336696:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581108.336719:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3341:1875463014235648:0@lo:400:kworker.0 00000100:00100000:3.0:1788581108.336741:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581108.336768:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014235520:0@lo:400:kworker.0 00000100:00100000:3.0:1788581108.336802:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581108.336821:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581108.336827:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014235392:0@lo:400:kworker.0 00000100:00100000:3.0:1788581108.336848:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581108.336878:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014235264 00000100:00100000:3.0:1788581108.336885:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014235264 00000100:00100000:3.0:1788581108.336931:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014235648 00000100:00100000:3.0:1788581108.336934:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014235648 00000100:00100000:3.0:1788581108.336956:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014235392 00000100:00100000:3.0:1788581108.336959:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014235392 00000100:00100000:3.0:1788581108.336975:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788581108.336983:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014235264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581108.337197:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014235264:12345-0@lo:400:kworker.0 Request processed in 213us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581108.337205:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788581108.337227:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788581108.337235:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3341:x1875463014235648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581108.337292:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3341:x1875463014235648:12345-0@lo:400:kworker.0 Request processed in 58us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581108.337311:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788581108.337324:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788581108.337330:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014235392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581108.337364:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014235392:12345-0@lo:400:kworker.0 Request processed in 34us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581108.337370:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788581108.337389:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014235776 00000100:00100000:3.0:1788581108.337394:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014235776 00000100:00100000:3.0:1788581108.337430:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014235520 00000100:00100000:3.0:1788581108.337433:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014235520 00000100:00100000:3.0:1788581108.337453:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788581108.337459:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014235776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581108.337493:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014235776:12345-0@lo:400:kworker.0 Request processed in 33us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581108.337499:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788581108.337510:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788581108.337516:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014235520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581108.337543:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014235520:12345-0@lo:400:kworker.0 Request processed in 28us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581108.337549:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788581108.337567:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014235136 00000100:00100000:3.0:1788581108.337571:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014235136 00000100:00100000:3.0:1788581108.337598:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788581108.337604:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014235136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581108.337633:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014235136:12345-0@lo:400:kworker.0 Request processed in 29us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581108.337639:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:3.0:1788581108.337679:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581108.337684:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581108.337686:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581108.337735:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014235392:0@lo:400:kworker.0 00010000:00080000:3.0:1788581108.337749:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076886d80 x1875463014235520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581108.337761:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014235520:0@lo:400:kworker.0 00000100:00100000:3.0:1788581108.337808:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014235136:0@lo:400:kworker.0 00000100:00100000:3.0:1788581108.337819:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3341:1875463014235648:0@lo:400:kworker.0 00000100:00100000:3.0:1788581108.337829:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014235264:0@lo:400:kworker.0 00010000:00080000:3.0:1788581108.337840:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076886a00 x1875463014235776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581108.337849:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014235776:0@lo:400:kworker.0 00000100:00100000:3.0:1788581108.612393:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581108.612433:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581108.612476:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581108.612482:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995326336 00000100:00100000:3.0:1788581108.612496:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581108.612498:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995326336 00000100:00100000:3.0:1788581108.612523:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581108.612545:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995326464 00000100:00100000:3.0:1788581108.612549:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995326464 00000100:00100000:0.0:1788581108.612570:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 83 00000100:00100000:2.0:1788581108.612617:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995326592 00000100:00100000:2.0:1788581108.612623:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995326592 00000100:00100000:2.0:1788581108.612656:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995326720 00000100:00100000:2.0:1788581108.612659:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995326720 00000100:00100000:2.0:1788581108.612683:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:2.0:1788581108.612692:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995326592:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581108.612772:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995326592:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 81us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581108.612780:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:2.0:1788581108.612797:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:2.0:1788581108.612804:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995326720:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581108.612828:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995326720:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 26us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581108.612833:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:2.0:1788581108.612860:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995326208 00000100:00100000:2.0:1788581108.612874:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995326208 00000100:00100000:2.0:1788581108.612901:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 228 00000100:00100000:2.0:1788581108.612908:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995326208:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581108.612934:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995326208:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 27us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581108.612941:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 228 00000100:00100000:0.0:1788581108.613131:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995326336:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581108.613169:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995326336:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 43us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581108.613220:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 84 00000100:00100000:3.0:1788581108.613231:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995326464:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581108.613309:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995326464:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 81us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581108.613316:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 84 00000100:00080000:3.0:1788581108.613367:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581108.613371:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581108.613374:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581108.614543:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 83 00010000:00010000:2.0:1788581108.784695:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581108.847923:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581108.847949:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014235904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581108.848021:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581108.848098:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014235904 00000100:00100000:2.0:1788581108.848105:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014235904 00000100:00100000:2.0:1788581108.848152:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788581108.848161:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014235904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581108.848199:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581108.848263:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014235904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581108.848270:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788581108.848322:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076314000 x1875463014235904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581108.848340:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014235904:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788581109.812297:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581110.835338:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581110.898538:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581110.898560:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014236032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581110.898648:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581110.898738:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014236032 00000100:00100000:3.0:1788581110.898747:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014236032 00000100:00100000:3.0:1788581110.898809:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788581110.898828:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014236032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581110.898864:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788581110.898912:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014236032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581110.898920:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788581110.898945:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788581110.898976:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190484ff480 x1875463014236032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581110.898997:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014236032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788581111.856277:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581112.885389:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581113.455918:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014236288:0@lo:400:kworker.0 00000100:00100000:1.0:1788581113.456051:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581113.456116:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014236800:0@lo:400:kworker.0 00000100:00100000:1.0:1788581113.456146:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581113.456183:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788581113.456189:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014236160:0@lo:400:kworker.0 00000100:00100000:1.0:1788581113.456230:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581113.456280:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3341:1875463014236672:0@lo:400:kworker.0 00000100:00100000:1.0:1788581113.456302:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581113.456331:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014236416:0@lo:400:kworker.0 00000100:00100000:1.0:1788581113.456357:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581113.456378:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581113.456384:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014236544:0@lo:400:kworker.0 00000100:00100000:1.0:1788581113.456404:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581113.456437:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014236288 00000100:00100000:1.0:1788581113.456447:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014236288 00000100:00100000:1.0:1788581113.456500:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014236672 00000100:00100000:1.0:1788581113.456503:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014236672 00000100:00100000:1.0:1788581113.456530:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014236416 00000100:00100000:1.0:1788581113.456533:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014236416 00000100:00100000:1.0:1788581113.456811:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788581113.456822:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014236288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581113.456891:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014236288:12345-0@lo:400:kworker.0 Request processed in 70us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581113.456898:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788581113.456919:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788581113.456926:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3341:x1875463014236672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581113.456967:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3341:x1875463014236672:12345-0@lo:400:kworker.0 Request processed in 42us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581113.456973:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788581113.456998:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788581113.457005:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014236416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581113.457038:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014236416:12345-0@lo:400:kworker.0 Request processed in 34us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581113.457045:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788581113.457065:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014236800 00000100:00100000:1.0:1788581113.457068:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014236800 00000100:00100000:1.0:1788581113.457096:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014236544 00000100:00100000:1.0:1788581113.457099:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014236544 00000100:00100000:1.0:1788581113.457120:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788581113.457126:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014236800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581113.457158:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014236800:12345-0@lo:400:kworker.0 Request processed in 32us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581113.457164:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788581113.457175:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788581113.457180:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014236544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581113.457205:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014236544:12345-0@lo:400:kworker.0 Request processed in 26us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581113.457224:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788581113.457261:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014236160 00000100:00100000:1.0:1788581113.457265:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014236160 00000100:00100000:1.0:1788581113.457291:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788581113.457298:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014236160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581113.457339:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014236160:12345-0@lo:400:kworker.0 Request processed in 41us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581113.457346:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:1.0:1788581113.457392:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581113.457397:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788581113.457400:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788581113.457444:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c61d500 x1875463014236544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581113.457460:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014236544:0@lo:400:kworker.0 00000100:00100000:1.0:1788581113.457473:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014236416:0@lo:400:kworker.0 00000100:00100000:1.0:1788581113.457505:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014236160:0@lo:400:kworker.0 00000100:00100000:1.0:1788581113.457516:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3341:1875463014236672:0@lo:400:kworker.0 00000100:00100000:1.0:1788581113.457527:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014236288:0@lo:400:kworker.0 00010000:00080000:1.0:1788581113.457537:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c61e300 x1875463014236800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581113.457558:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014236800:0@lo:400:kworker.0 00000100:00100000:3.0:1788581113.750595:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581113.750770:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581113.750803:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581113.750838:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995326976 00000100:00100000:3.0:1788581113.750851:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995326976 00000100:00100000:3.0:1788581113.750926:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995327104 00000100:00100000:3.0:1788581113.750930:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995327104 00000100:00100000:3.0:1788581113.750959:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 88 00000100:00100000:3.0:1788581113.750969:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2375:x1875462995326976:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581113.751065:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2375:x1875462995326976:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 97us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581113.751073:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 88 00000100:00100000:3.0:1788581113.751092:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 89 00000100:00100000:3.0:1788581113.751098:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2375:x1875462995327104:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581113.751137:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2375:x1875462995327104:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 39us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581113.751143:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 89 00000100:00080000:3.0:1788581113.751162:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581113.751195:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581113.751272:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995327232 00000100:00100000:3.0:1788581113.751276:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995327232 00000100:00100000:3.0:1788581113.751315:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:3.0:1788581113.751324:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2371:x1875462995327232:12345-192.168.201.13@tcp:9:kworker.0 00000020:00000080:3.0:1788581113.751351:0:10329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a70080 00000100:00080000:3.0:1788581113.751361:0:10329:0:(import.c:65:import_set_state_nolock()) ffff9190779b7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788581113.751410:0:10329:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788581113.751707:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995326848 00000100:00100000:2.0:1788581113.751712:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995326848 00000100:00100000:2.0:1788581113.751749:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 230 00000100:00100000:2.0:1788581113.751757:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2375:x1875462995326848:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581113.751797:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2375:x1875462995326848:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 41us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581113.751804:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 230 00000100:00100000:2.0:1788581113.751876:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581113.751904:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995327360 00000100:00100000:2.0:1788581113.751909:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995327360 00000100:00100000:2.0:1788581113.751940:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:2.0:1788581113.751947:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2371:x1875462995327360:12345-192.168.201.13@tcp:9:kworker.0 00000020:00000080:2.0:1788581113.751961:0:6723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a70087 00000100:00080000:2.0:1788581113.751967:0:6723:0:(import.c:65:import_set_state_nolock()) ffff9190779b4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788581113.752000:0:6723:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788581113.752399:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+2:2371:x1875462995327360:12345-192.168.201.13@tcp:9:kworker.0 Request processed in 450us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581113.752406:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 15 00010000:00010000:2.0:1788581113.752430:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581113.755235:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+2:2371:x1875462995327232:12345-192.168.201.13@tcp:9:kworker.0 Request processed in 3893us (4020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581113.755280:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 14 00010000:00010000:3.0:1788581113.755331:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788581113.755344:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581113.755350:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788581113.907708:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581113.969936:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014236928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581113.970034:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581113.970662:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014236928 00000100:00100000:3.0:1788581113.970680:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014236928 00000100:00100000:3.0:1788581113.970775:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788581113.970789:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014236928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581113.970840:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788581113.970923:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014236928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581113.970931:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788581113.971728:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190484fce00 x1875463014236928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581113.971757:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014236928:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788581114.927748:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581115.955354:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581116.015744:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581116.015781:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014237056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581116.015881:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581116.020489:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014237056 00000100:00100000:2.0:1788581116.020516:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014237056 00000100:00100000:2.0:1788581116.020756:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788581116.020771:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014237056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581116.020831:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581116.020973:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014237056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 206us (5091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581116.020997:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788581116.021552:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190484ff100 x1875463014237056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581116.021695:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014237056:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788581116.022353:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788581116.976656:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788581117.176094:0:7696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0cbb0a85-7fe6-4f80-9c92-71853a6f2376 00000020:00000080:0.0:1788581117.176104:0:7696:0:(genops.c:885:class_export_put()) final put ffff9190779b3800/0cbb0a85-7fe6-4f80-9c92-71853a6f2376 00000020:00000080:2.0:1788581117.176166:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff9190779b3800/0cbb0a85-7fe6-4f80-9c92-71853a6f2376 for lustre-OST0001 00000020:00000080:2.0:1788581117.176218:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9190779b4000 for lustre-OST0001 00000001:00100000:3.0:1788581117.677981:0:6750:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0cbb0a85-7fe6-4f80-9c92-71853a6f2376 00000020:00000080:3.0:1788581117.677991:0:6750:0:(genops.c:885:class_export_put()) final put ffff9190779b2000/0cbb0a85-7fe6-4f80-9c92-71853a6f2376 00000020:00000080:3.0:1788581117.678684:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff9190779b2000/0cbb0a85-7fe6-4f80-9c92-71853a6f2376 for lustre-OST0000 00000020:00000080:3.0:1788581117.678743:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9190779b7000 for lustre-OST0000 00010000:00010000:2.0:1788581117.999837:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581118.578155:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581118.578182:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014237440:0@lo:400:kworker.0 00000100:00100000:2.0:1788581118.578286:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581118.578371:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014237440 00000100:00100000:2.0:1788581118.578378:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014237440 00000100:00100000:2.0:1788581118.578439:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788581118.578450:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014237440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581118.578508:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014237440:12345-0@lo:400:kworker.0 Request processed in 60us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581118.578515:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1788581118.578537:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581118.578576:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014237440:0@lo:400:kworker.0 00000100:00100000:2.0:1788581118.578613:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014237568:0@lo:400:kworker.0 00000100:00100000:2.0:1788581118.578640:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581118.578669:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014237568 00000100:00100000:2.0:1788581118.578672:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014237568 00000100:00100000:2.0:1788581118.578703:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788581118.578710:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014237568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581118.578754:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014237568:12345-0@lo:400:kworker.0 Request processed in 45us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581118.578761:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788581118.578779:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788581118.578797:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c61a300 x1875463014237568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581118.578809:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014237568:0@lo:400:kworker.0 00000100:00100000:0.0:1788581118.578932:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014237184:0@lo:400:kworker.0 00000100:00100000:0.0:1788581118.578969:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581118.579020:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014237696:0@lo:400:kworker.0 00000100:00100000:0.0:1788581118.579044:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581118.579068:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788581118.579074:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014237312:0@lo:400:kworker.0 00000100:00100000:0.0:1788581118.579097:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581118.579116:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014237824:0@lo:400:kworker.0 00000100:00100000:0.0:1788581118.579151:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581118.579183:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014237696 00000100:00100000:0.0:1788581118.579187:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014237696 00000100:00100000:0.0:1788581118.579215:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014237312 00000100:00100000:0.0:1788581118.579219:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014237312 00000100:00100000:0.0:1788581118.579235:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788581118.579269:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014237696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581118.579304:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014237696:12345-0@lo:400:kworker.0 Request processed in 62us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581118.579317:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788581118.579330:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788581118.579336:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014237312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581118.579367:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014237312:12345-0@lo:400:kworker.0 Request processed in 31us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581118.579372:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788581118.579390:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014237824 00000100:00100000:0.0:1788581118.579393:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014237824 00000100:00100000:0.0:1788581118.579417:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788581118.579423:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014237824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581118.579455:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014237824:12345-0@lo:400:kworker.0 Request processed in 32us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581118.579460:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788581118.579486:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014237312:0@lo:400:kworker.0 00010000:00080000:0.0:1788581118.579496:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c61bb80 x1875463014237824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581118.579505:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014237824:0@lo:400:kworker.0 00000100:00100000:0.0:1788581118.579514:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014237696:0@lo:400:kworker.0 00000100:00100000:2.0:1788581118.579706:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014237184 00000100:00100000:2.0:1788581118.579710:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014237184 00000100:00100000:2.0:1788581118.579743:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788581118.579750:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014237184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581118.579794:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014237184:12345-0@lo:400:kworker.0 Request processed in 44us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581118.579801:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:2.0:1788581118.579828:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581118.579833:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581118.580615:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014237184:0@lo:400:kworker.0 00000100:00100000:2.0:1788581118.855413:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581118.855462:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581118.855494:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581118.855526:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995327488 00000100:00100000:2.0:1788581118.855537:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995327488 00000100:00100000:2.0:1788581118.855586:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 232 00000100:00100000:2.0:1788581118.855596:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2373:x1875462995327488:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581118.855679:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2373:x1875462995327488:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 84us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581118.855688:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 232 00000100:00100000:2.0:1788581118.855743:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995327744 00000100:00100000:2.0:1788581118.855747:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995327744 00000100:00100000:2.0:1788581118.855786:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995327616 00000100:00100000:2.0:1788581118.855789:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995327616 00000100:00100000:2.0:1788581118.855810:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 93 00000100:00100000:2.0:1788581118.855817:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2373:x1875462995327744:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581118.855851:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2373:x1875462995327744:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 34us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581118.855858:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 93 00000100:00100000:2.0:1788581118.855870:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 94 00000100:00100000:2.0:1788581118.855876:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2373:x1875462995327616:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581118.855901:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2373:x1875462995327616:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 24us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581118.855907:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 94 00000100:00080000:2.0:1788581118.856047:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788581119.023774:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581119.097520:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581119.097551:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014237952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581119.097630:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581119.110638:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014237952 00000100:00100000:2.0:1788581119.110654:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014237952 00000100:00100000:2.0:1788581119.110705:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788581119.110715:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014237952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581119.110798:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581119.110881:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014237952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (13251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581119.110889:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788581119.126051:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190484fd180 x1875463014237952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581119.126081:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014237952:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788581119.585814:0:11070:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788581120.047606:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581121.071424:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581121.136581:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581121.136602:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014238080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581121.136685:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581121.137064:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014238080 00000100:00100000:2.0:1788581121.137073:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014238080 00000100:00100000:2.0:1788581121.137190:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788581121.137211:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014238080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581121.137277:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581121.137331:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014238080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581121.137338:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788581121.137383:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190484fd180 x1875463014238080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581121.137403:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014238080:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788581121.137665:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788581122.096606:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581123.119654:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581123.696995:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014238464:0@lo:400:kworker.0 00000100:00100000:1.0:1788581123.697138:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581123.697197:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581123.697204:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014238592:0@lo:400:kworker.0 00000100:00100000:1.0:1788581123.697511:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581123.697548:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014238464 00000100:00100000:1.0:1788581123.697556:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014238464 00000100:00100000:1.0:1788581123.697611:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788581123.697622:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014238464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581123.697688:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014238464:12345-0@lo:400:kworker.0 Request processed in 68us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581123.697695:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788581123.697718:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014238592 00000100:00100000:1.0:1788581123.697722:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014238592 00000100:00100000:1.0:1788581123.697771:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788581123.697778:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014238592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581123.697807:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014238592:12345-0@lo:400:kworker.0 Request processed in 31us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581123.697813:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788581123.697851:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c61ea00 x1875463014238592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581123.697866:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014238592:0@lo:400:kworker.0 00000100:00100000:1.0:1788581123.697878:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014238464:0@lo:400:kworker.0 00000100:00100000:2.0:1788581123.698030:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014238208:0@lo:400:kworker.0 00000100:00100000:2.0:1788581123.698076:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581123.698128:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014238720:0@lo:400:kworker.0 00000100:00100000:2.0:1788581123.698150:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581123.698169:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788581123.698175:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014238336:0@lo:400:kworker.0 00000100:00100000:2.0:1788581123.698194:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581123.698220:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014238848:0@lo:400:kworker.0 00000100:00100000:2.0:1788581123.698261:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581123.698296:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014238720 00000100:00100000:2.0:1788581123.698300:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014238720 00000100:00100000:2.0:1788581123.698326:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014238336 00000100:00100000:2.0:1788581123.698330:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014238336 00000100:00100000:2.0:1788581123.698346:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788581123.698352:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014238720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581123.698388:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014238720:12345-0@lo:400:kworker.0 Request processed in 36us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581123.698405:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788581123.698416:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788581123.698419:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014238336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581123.698439:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014238336:12345-0@lo:400:kworker.0 Request processed in 19us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581123.698442:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788581123.698460:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014238336:0@lo:400:kworker.0 00000100:00100000:2.0:1788581123.698465:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014238720:0@lo:400:kworker.0 00000100:00080000:3.0:1788581123.698883:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581123.698888:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581123.698982:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014238208 00000100:00100000:1.0:1788581123.698986:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014238208 00000100:00100000:1.0:1788581123.699065:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788581123.699074:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014238208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581123.699126:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014238208:12345-0@lo:400:kworker.0 Request processed in 54us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581123.699139:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788581123.699596:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014238848 00000100:00100000:0.0:1788581123.699607:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014238848 00000100:00100000:0.0:1788581123.699668:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788581123.699676:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014238848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581123.699727:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014238848:12345-0@lo:400:kworker.0 Request processed in 52us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581123.699733:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788581123.700356:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788581123.711163:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c61f100 x1875463014238848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581123.711184:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014238848:0@lo:400:kworker.0 00000100:00100000:1.0:1788581123.711198:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014238208:0@lo:400:kworker.0 00000020:00000080:0.0:1788581123.833470:0:11218:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcda51f550 20000000:00000080:0.0:1788581123.833488:0:11218:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91907ba12c00 uarg=0000000000000000 20000000:01000000:0.0:1788581123.833524:0:11218:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788581123.833530:0:11218:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788581123.833535:0:11218:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788581123.834228:0:11219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788581123.834673:0:11218:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788581123.841703:0:11218:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788581123.841900:0:11218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91907bb82200/0xf54e3944c2a7008e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581123.841921:0:11218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190414b3400/0xf54e3944c2a70033 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f54 expref: 12 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581123.841930:0:11218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919040030a00/0xf54e3944c2a70041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a7003a expref: 18 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581123.841937:0:11218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919040031400/0xf54e3944c2a7004f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a70048 expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581123.841944:0:11218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919040031a00/0xf54e3944c2a7005d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a70056 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581123.841952:0:11218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190821cee00/0xf54e3944c2a70072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f8c expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581123.841976:0:11218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91907bb82200/0xf54e3944c2a7008e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581123.842214:0:11218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190821cee00/0xf54e3944c2a70072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f8c expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581123.842230:0:11218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9190821cee00/0xf54e3944c2a70072 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f8c expref: 12 pid: 5871 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581123.842687:0:11218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c619880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11218:1875463014238976:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581123.842855:0:11218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919040031a00/0xf54e3944c2a7005d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a70056 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581123.842865:0:11218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919040031a00/0xf54e3944c2a7005d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a70056 expref: 18 pid: 5871 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581123.842875:0:11218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11218:1875463014239104:0@lo:104: 00000100:00100000:2.0:1788581123.842917:0:11218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581123.842960:0:11218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919040031400/0xf54e3944c2a7004f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a70048 expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581123.842968:0:11218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919040031400/0xf54e3944c2a7004f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a70048 expref: 18 pid: 5870 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581123.842976:0:11218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c619f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11218:1875463014239232:0@lo:104: 00000100:00100000:2.0:1788581123.843011:0:11218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581123.843053:0:11218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919040030a00/0xf54e3944c2a70041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a7003a expref: 18 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581123.843078:0:11218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919040030a00/0xf54e3944c2a70041 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a7003a expref: 18 pid: 5869 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581123.843100:0:11218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c618700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11218:1875463014239360:0@lo:104: 00000100:00100000:2.0:1788581123.843124:0:11218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581123.843144:0:11218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190414b3400/0xf54e3944c2a70033 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f54 expref: 12 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581123.843152:0:11218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9190414b3400/0xf54e3944c2a70033 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f54 expref: 12 pid: 5870 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581123.843161:0:11218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c619500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11218:1875463014239488:192.168.201.13@tcp:104: 00000100:00100000:2.0:1788581123.843185:0:11218:0:(client.c:2715:ptlrpc_set_wait()) set ffff91905a3a9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581123.843279:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014239104 00000100:00100000:1.0:1788581123.843288:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014239104 00000100:00100000:1.0:1788581123.843333:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014239232 00000100:00100000:1.0:1788581123.843336:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014239232 00000100:00100000:1.0:1788581123.843348:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014239360 00000100:00100000:1.0:1788581123.843350:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014239360 00000100:00100000:1.0:1788581123.843364:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788581123.843373:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+5:11218:x1875463014239104:12345-0@lo:104: 00010000:00010000:1.0:1788581123.843385:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff919040030200/0xf54e3944c2a70056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a7005d expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843454:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788581123.843460:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+5:11218:x1875463014239104:12345-0@lo:104: Request processed in 89us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581123.843467:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788581123.843487:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788581123.843492:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c618a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+4:11218:x1875463014239232:12345-0@lo:104: 00010000:00010000:1.0:1788581123.843500:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a70048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a7004f expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843536:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788581123.843547:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c618a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+4:11218:x1875463014239232:12345-0@lo:104: Request processed in 55us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581123.843552:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788581123.843564:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788581123.843569:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:11218:x1875463014239360:12345-0@lo:104: 00010000:00010000:1.0:1788581123.843575:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a7003a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a70041 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843609:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788581123.843614:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:11218:x1875463014239360:12345-0@lo:104: Request processed in 44us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581123.843619:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788581123.843634:0:6738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788581123.843640:0:6738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919040030200/0xf54e3944c2a70056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a7005d expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843647:0:6738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040030200 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:1.0:1788581123.843651:0:6738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919040030200/0xf54e3944c2a70056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a7005d expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843659:0:6738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919040030200/0xf54e3944c2a70056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a7005d expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581123.843666:0:6738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919040030200/0xf54e3944c2a70056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a7005d expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581123.843671:0:6738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788581123.843699:0:6738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919040030200/0xf54e3944c2a70056 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a7005d expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843715:0:6738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581123.843737:0:6738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919040030200/0xf54e3944c2a70056 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a7005d expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843744:0:6738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919040030200/0xf54e3944c2a70056 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a7005d expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843755:0:6738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581123.843758:0:6738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a70048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a7004f expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843764:0:6738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040031600 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:1.0:1788581123.843767:0:6738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a70048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a7004f expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843773:0:6738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a70048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a7004f expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581123.843779:0:6738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a70048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a7004f expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581123.843785:0:6738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788581123.843798:0:6738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a70048 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a7004f expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843804:0:6738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581123.843809:0:6738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a70048 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a7004f expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843815:0:6738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919040031600/0xf54e3944c2a70048 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a7004f expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843830:0:6738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581123.843833:0:6738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a7003a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a70041 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843839:0:6738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040030c00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:1.0:1788581123.843842:0:6738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a7003a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a70041 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843848:0:6738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a7003a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a70041 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581123.843854:0:6738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a7003a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a70041 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581123.843860:0:6738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788581123.843872:0:6738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a7003a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a70041 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843877:0:6738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581123.843894:0:6738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a7003a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a70041 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843902:0:6738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919040030c00/0xf54e3944c2a7003a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a70041 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.843916:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581123.843918:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581123.843920:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581123.843927:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581123.843939:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581123.843960:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014239616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581123.843994:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581123.844019:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581123.844024:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014239744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581123.844058:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581123.844085:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014239872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581123.844105:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581123.844134:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014239616 00000100:00100000:1.0:1788581123.844138:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014239616 00010000:00010000:1.0:1788581123.844158:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919040031a00/0xf54e3944c2a7005d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a70056 expref: 19 pid: 5871 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581123.844176:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014239744 00000100:00100000:1.0:1788581123.844179:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014239744 00010000:00010000:1.0:1788581123.844188:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919040031400/0xf54e3944c2a7004f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a70048 expref: 20 pid: 5870 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581123.844197:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014239872 00000100:00100000:1.0:1788581123.844199:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014239872 00010000:00010000:1.0:1788581123.844208:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919040030a00/0xf54e3944c2a70041 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a7003a expref: 21 pid: 5869 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581123.844219:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788581123.844225:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+21:3338:x1875463014239616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581123.844235:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581123.844240:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919040031a00/0xf54e3944c2a7005d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a70056 expref: 21 pid: 5871 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.844282:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919040031a00/0xf54e3944c2a7005d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a70056 expref: 21 pid: 5871 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.844299:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581123.844327:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+21:3338:x1875463014239616:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581123.844333:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788581123.844374:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788581123.844380:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+20:3338:x1875463014239744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581123.844388:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581123.844392:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919040031400/0xf54e3944c2a7004f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a70048 expref: 20 pid: 5870 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.844399:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919040031400/0xf54e3944c2a7004f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a70048 expref: 20 pid: 5870 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.844409:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581123.844427:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+20:3338:x1875463014239744:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581123.844432:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788581123.844442:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788581123.844447:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014239872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581123.844457:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581123.844461:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919040030a00/0xf54e3944c2a70041 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a7003a expref: 19 pid: 5869 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.844468:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919040030a00/0xf54e3944c2a70041 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a7003a expref: 19 pid: 5869 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.844487:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581123.844513:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014239872:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581123.844518:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788581123.844559:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014239872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581123.844581:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014239744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581123.844587:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014239616:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581123.844830:0:11218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919040031a00/0xf54e3944c2a7005d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a70056 expref: 18 pid: 5871 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581123.844842:0:11218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11218:1875463014239104:0@lo:104: 00010000:00010000:2.0:1788581123.844853:0:11218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919040031400/0xf54e3944c2a7004f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a70048 expref: 17 pid: 5870 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581123.844860:0:11218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c619f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11218:1875463014239232:0@lo:104: 00010000:00010000:2.0:1788581123.844868:0:11218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919040030a00/0xf54e3944c2a70041 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a7003a expref: 16 pid: 5869 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581123.844875:0:11218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c618700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11218:1875463014239360:0@lo:104: 00000100:00100000:2.0:1788581123.849679:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581123.849760:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581123.849941:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995327872 00000100:00100000:1.0:1788581123.849951:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995327872 00010000:00010000:1.0:1788581123.849994:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190821cee00/0xf54e3944c2a70072 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f8c expref: 13 pid: 5871 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581123.850045:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995328000 00000100:00100000:1.0:1788581123.850048:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995328000 00010000:00010000:1.0:1788581123.850060:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190414b3400/0xf54e3944c2a70033 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f54 expref: 14 pid: 5870 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581123.850082:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 28 00000100:00100000:1.0:1788581123.850091:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+14:2375:x1875462995327872:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581123.850108:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581123.850112:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190821cee00/0xf54e3944c2a70072 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f8c expref: 14 pid: 5871 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.850125:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190821cee00/0xf54e3944c2a70072 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f8c expref: 14 pid: 5871 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.850159:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581123.850225:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+14:2375:x1875462995327872:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 133us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581123.850233:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 28 00000100:00100000:1.0:1788581123.850280:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 29 00000100:00100000:1.0:1788581123.850287:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995328000:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581123.850295:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581123.850300:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190414b3400/0xf54e3944c2a70033 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f54 expref: 13 pid: 5870 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.850309:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190414b3400/0xf54e3944c2a70033 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f54 expref: 13 pid: 5870 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.850322:0:5863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91907bb82200/0xf54e3944c2a7008e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.850330:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91907bb82200/0xf54e3944c2a7008e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.850348:0:5863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91907bb82200/0xf54e3944c2a7008e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.850355:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91907bb82200/0xf54e3944c2a7008e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.850361:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91907bb82200/0xf54e3944c2a7008e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.850367:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91907bb82200/0xf54e3944c2a7008e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.850378:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb82200 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581123.850383:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91907bb82200/0xf54e3944c2a7008e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.850391:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91907bb82200/0xf54e3944c2a7008e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.850401:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91907bb82200/0xf54e3944c2a7008e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581123.850410:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581123.850433:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995328000:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 147us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581123.850439:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 29 00010000:00010000:0.0:1788581123.850834:0:11218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190821cee00/0xf54e3944c2a70072 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f8c expref: 12 pid: 5871 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581123.850852:0:11218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c619880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11218:1875463014238976:192.168.201.13@tcp:104: 00010000:00010000:0.0:1788581123.850865:0:11218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190414b3400/0xf54e3944c2a70033 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f54 expref: 11 pid: 5870 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581123.850874:0:11218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c619500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11218:1875463014239488:192.168.201.13@tcp:104: 00010000:00010000:0.0:1788581123.850904:0:11218:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91907bb82200/0xf54e3944c2a7008e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581123.850914:0:11218:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91907bb82200/0xf54e3944c2a7008e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581123.850919:0:11218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91907bb82200/0xf54e3944c2a7008e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581123.850937:0:11218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91907bb82200/0xf54e3944c2a7008e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581123.973351:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581123.973402:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581123.973523:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995328128 00000100:00100000:0.0:1788581123.973536:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995328128 00000100:00100000:0.0:1788581123.973597:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995328256 00000100:00100000:0.0:1788581123.973600:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995328256 00000100:00100000:0.0:1788581123.973626:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 98 00000100:00100000:0.0:1788581123.973637:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2375:x1875462995328128:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581123.973716:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2375:x1875462995328128:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 81us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581123.973724:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 98 00000100:00100000:0.0:1788581123.973740:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 99 00000100:00100000:0.0:1788581123.973747:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2375:x1875462995328256:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581123.973773:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2375:x1875462995328256:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 27us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581123.973779:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 99 00000100:00080000:1.0:1788581123.973973:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788581124.144186:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581124.207533:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014240000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581124.207610:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581124.207850:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014240000 00000100:00100000:2.0:1788581124.207859:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014240000 00000100:00100000:2.0:1788581124.207940:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788581124.207950:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014240000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581124.208003:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581124.208069:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014240000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581124.208076:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788581124.208432:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190484fce00 x1875463014240000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581124.208450:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014240000:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1788581124.977425:0:5874:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788581124.977434:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91907f8f1000 from 7 10000000:01000000:1.0:1788581124.977439:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788581124.977490:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a70095 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581124.977503:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a70095 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581124.977514:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a70095 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581124.977562:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014240128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788581124.977648:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581124.977709:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581124.977872:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014240128 00000100:00100000:3.0:1788581124.977881:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014240128 00000100:00100000:3.0:1788581124.977943:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788581124.977953:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014240128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581124.977965:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581124.977986:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821cf800/0xf54e3944c2a7009c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a70095 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.978009:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821cf800/0xf54e3944c2a7009c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a70095 expref: 17 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.978031:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821cf800/0xf54e3944c2a7009c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a70095 expref: 17 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.978041:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf800, rc 0) 00000100:00100000:3.0:1788581124.978089:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014240128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581124.978097:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788581124.978149:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014240128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581124.978163:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a70095 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7009c expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.978170:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a70095 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a7009c expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581124.978225:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014240256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581124.978267:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581124.978282:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048dc96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581124.978297:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014240256 00000100:00100000:3.0:1788581124.978301:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014240256 00000100:00100000:3.0:1788581124.978323:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788581124.978330:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014240256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581124.978582:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014240256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581124.978595:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788581124.978641:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014240256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581124.978669:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014240384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581124.978706:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581124.978724:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048dc96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581124.978736:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014240384 00000100:00100000:3.0:1788581124.978739:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014240384 00000100:00100000:3.0:1788581124.978759:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788581124.978765:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014240384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581124.978899:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014240384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581124.978905:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788581124.978941:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014240384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788581124.979592:0:11235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788581124.979671:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788581124.979687:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788581124.979696:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a70095 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7009c expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.979706:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a70095 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7009c expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581124.979717:0:5874:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788581124.979719:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91906c6c6000 from 7 10000000:01000000:3.0:1788581124.979722:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581124.979748:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a700a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.979763:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a700a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.979772:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a700a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581124.979790:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014240512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581124.979829:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581124.979847:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048dc9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581124.979863:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014240512 00000100:00100000:3.0:1788581124.979868:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014240512 00000100:00100000:3.0:1788581124.979897:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788581124.979904:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014240512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581124.979913:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581124.979923:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821cf000/0xf54e3944c2a700aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a700a3 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.979940:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821cf000/0xf54e3944c2a700aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a700a3 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.979949:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821cf000/0xf54e3944c2a700aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a700a3 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.979957:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf000, rc 0) 00000100:00100000:3.0:1788581124.979987:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014240512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581124.979993:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788581124.980052:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014240512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581124.980064:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a700a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a700aa expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.980072:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a700a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a700aa expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581124.980112:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014240640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581124.980136:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581124.980149:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048dc9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581124.980160:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014240640 00000100:00100000:3.0:1788581124.980164:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014240640 00000100:00100000:3.0:1788581124.980182:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788581124.980188:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014240640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581124.980400:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014240640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 212us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581124.980407:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788581124.980434:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014240640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581124.980457:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014240768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581124.980490:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581124.980518:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048dc9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581124.980529:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014240768 00000100:00100000:3.0:1788581124.980532:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014240768 00000100:00100000:3.0:1788581124.980551:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788581124.980557:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014240768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581124.980674:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014240768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581124.980687:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788581124.980721:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014240768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788581124.994709:0:11236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788581124.994870:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788581124.994894:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788581124.994908:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a700a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a700aa expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.994921:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a700a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a700aa expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581124.994933:0:5874:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788581124.994936:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91904733b800 from 7 10000000:01000000:3.0:1788581124.994938:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581124.994979:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a700b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.994987:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a700b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.995017:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a700b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581124.995049:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014240896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581124.995139:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581124.995187:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048dc9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581124.995210:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014240896 00000100:00100000:3.0:1788581124.995219:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014240896 00000100:00100000:3.0:1788581124.995278:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788581124.995288:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014240896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581124.995318:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581124.995331:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821ce000/0xf54e3944c2a700b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a700b1 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.995355:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821ce000/0xf54e3944c2a700b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a700b1 expref: 19 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.995366:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821ce000/0xf54e3944c2a700b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a700b1 expref: 19 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.995374:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce000, rc 0) 00000100:00100000:3.0:1788581124.995412:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014240896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581124.995418:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788581124.995468:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014240896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581124.995482:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a700b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a700b8 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581124.995492:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a700b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a700b8 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581124.995542:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014241024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581124.995569:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581124.995587:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048dc9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581124.995599:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014241024 00000100:00100000:3.0:1788581124.995603:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014241024 00000100:00100000:3.0:1788581124.995624:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788581124.995630:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014241024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581124.995877:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014241024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581124.995884:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788581124.995915:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014241024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581124.995941:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014241152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581124.995977:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581124.995989:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048dc9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581124.995999:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014241152 00000100:00100000:3.0:1788581124.996002:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014241152 00000100:00100000:3.0:1788581124.996034:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788581124.996041:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014241152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581124.996161:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014241152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581124.996167:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788581124.996198:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014241152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788581125.005915:0:11237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788581125.006351:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788581125.006371:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788581125.006382:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a700b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a700b8 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581125.006394:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a700b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a700b8 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581125.172749:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581125.892530:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581125.892588:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995328384 00000100:00100000:3.0:1788581125.892598:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995328384 00000100:00100000:3.0:1788581125.892660:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 243 00000100:00100000:3.0:1788581125.892680:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+11:5613:x1875462995328384:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581125.892698:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581125.892713:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821cec00/0xf54e3944c2a700bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8fb6 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581125.892820:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821cec00/0xf54e3944c2a700bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fb6 expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581125.892831:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821cec00/0xf54e3944c2a700bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fb6 expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581125.892839:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cec00, rc 0) 00000100:00100000:3.0:1788581125.892900:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:5613:x1875462995328384:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 Request processed in 222us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581125.892907:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 243 00000100:00100000:0.0:1788581125.894873:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581125.896020:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995328512 00000100:00100000:3.0:1788581125.896033:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995328512 00000100:00100000:3.0:1788581125.896096:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 244 00000100:00100000:3.0:1788581125.896107:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:5613:x1875462995328512:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581125.896435:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:5613:x1875462995328512:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 Request processed in 329us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581125.896443:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 244 00000100:00100000:1.0:1788581125.904972:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581125.905071:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995328640 00000100:00100000:3.0:1788581125.905083:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995328640 00000100:00100000:3.0:1788581125.905145:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 245 00000100:00100000:3.0:1788581125.905156:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:5613:x1875462995328640:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581125.905417:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:5613:x1875462995328640:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 Request processed in 262us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581125.905425:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 245 00000100:00100000:2.0:1788581125.919979:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581125.920679:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995328768 00000100:00100000:0.0:1788581125.920699:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995328768 00000100:00100000:0.0:1788581125.920769:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 246 00000100:00100000:0.0:1788581125.920779:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:5613:x1875462995328768:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581125.920797:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581125.920815:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a700c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8fbd expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581125.920845:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a700c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fbd expref: 13 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581125.920856:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a700c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fbd expref: 13 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581125.920867:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22a00, rc 0) 00000100:00100000:0.0:1788581125.920926:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:5613:x1875462995328768:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 Request processed in 148us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581125.920933:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 246 00000100:00100000:2.0:1788581125.930712:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581125.930775:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995328896 00000100:00100000:0.0:1788581125.930785:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995328896 00000100:00100000:0.0:1788581125.930844:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 247 00000100:00100000:0.0:1788581125.930854:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:5613:x1875462995328896:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581125.931141:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:5613:x1875462995328896:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 Request processed in 287us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581125.931149:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 247 00000100:00100000:1.0:1788581125.934328:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581125.934437:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995329024 00000100:00100000:2.0:1788581125.934447:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995329024 00000100:00100000:2.0:1788581125.934508:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 248 00000100:00100000:2.0:1788581125.934517:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:5613:x1875462995329024:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581125.934741:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:5613:x1875462995329024:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 Request processed in 223us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581125.934751:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 248 00010000:00010000:1.0:1788581126.191445:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581126.260014:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014241280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581126.260099:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581126.261292:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014241280 00000100:00100000:0.0:1788581126.261303:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014241280 00000100:00100000:0.0:1788581126.261377:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788581126.261387:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014241280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581126.261435:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788581126.261572:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581126.265373:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014241280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3972us (5258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581126.265390:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788581126.268555:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190484fce00 x1875463014241280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581126.268586:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014241280:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788581127.217431:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581128.239475:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581128.815705:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014241792:0@lo:400:kworker.0 00000100:00100000:2.0:1788581128.815789:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581128.815858:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788581128.815864:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014241408:0@lo:400:kworker.0 00000100:00100000:2.0:1788581128.815894:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581128.815915:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3338:1875463014241920:0@lo:400:kworker.0 00000100:00100000:2.0:1788581128.815941:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581128.815979:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014241536:0@lo:400:kworker.0 00000100:00100000:2.0:1788581128.816012:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581128.816030:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014242048:0@lo:400:kworker.0 00000100:00100000:2.0:1788581128.816050:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581128.816068:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581128.816073:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014241664:0@lo:400:kworker.0 00000100:00100000:2.0:1788581128.816093:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581128.816127:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014241792 00000100:00100000:2.0:1788581128.816135:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014241792 00000100:00100000:2.0:1788581128.816200:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014242048 00000100:00100000:2.0:1788581128.816204:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014242048 00000100:00100000:2.0:1788581128.816228:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788581128.816237:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014241792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581128.816492:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014241792:12345-0@lo:400:kworker.0 Request processed in 124us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581128.816500:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788581128.816516:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788581128.816522:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f4370b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014242048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581128.816554:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f4370b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014242048:12345-0@lo:400:kworker.0 Request processed in 32us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581128.816559:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788581128.816577:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014241408 00000100:00100000:2.0:1788581128.816581:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014241408 00000100:00100000:2.0:1788581128.816604:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788581128.816611:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3338:x1875463014241408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581128.816641:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3338:x1875463014241408:12345-0@lo:400:kworker.0 Request processed in 30us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581128.816656:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788581128.816685:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014241920 00000100:00100000:2.0:1788581128.816689:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014241920 00000100:00100000:2.0:1788581128.816713:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014241536 00000100:00100000:2.0:1788581128.816717:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014241536 00000100:00100000:2.0:1788581128.816727:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014241664 00000100:00100000:2.0:1788581128.816731:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014241664 00000100:00100000:2.0:1788581128.816744:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788581128.816749:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3338:x1875463014241920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581128.816778:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3338:x1875463014241920:12345-0@lo:400:kworker.0 Request processed in 29us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581128.816784:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788581128.816795:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788581128.816800:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f4370ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014241536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581128.816824:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f4370ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014241536:12345-0@lo:400:kworker.0 Request processed in 23us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581128.816829:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788581128.816838:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788581128.816844:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014241664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581128.816865:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014241664:12345-0@lo:400:kworker.0 Request processed in 21us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581128.816870:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788581128.816895:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581128.816900:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581128.816902:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581128.816941:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014241664:0@lo:400:kworker.0 00000100:00100000:2.0:1788581128.816977:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014241536:0@lo:400:kworker.0 00010000:00080000:2.0:1788581128.816989:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c61ad80 x1875463014242048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581128.816999:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014242048:0@lo:400:kworker.0 00000100:00100000:2.0:1788581128.817029:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014241408:0@lo:400:kworker.0 00000100:00100000:2.0:1788581128.817039:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3338:1875463014241920:0@lo:400:kworker.0 00010000:00080000:2.0:1788581128.817048:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c618700 x1875463014241792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581128.817057:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014241792:0@lo:400:kworker.0 00000001:02000400:1.0:1788581128.883270:0:11417:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788581129.100416:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581129.100451:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581129.100521:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581129.100961:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995329152 00000100:00100000:0.0:1788581129.100971:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995329152 00000100:00100000:0.0:1788581129.101021:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 250 00000100:00100000:3.0:1788581129.101025:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995329408 00000100:00100000:3.0:1788581129.101030:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995329408 00000100:00100000:0.0:1788581129.101032:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2375:x1875462995329152:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581129.101066:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995329280 00000100:00100000:3.0:1788581129.101069:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995329280 00000100:00100000:3.0:1788581129.101089:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 103 00000100:00100000:3.0:1788581129.101096:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2375:x1875462995329408:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581129.101098:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2375:x1875462995329152:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 70us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581129.101105:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 250 00000100:00100000:3.0:1788581129.101126:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2375:x1875462995329408:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 30us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581129.101188:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 103 00000100:00100000:3.0:1788581129.101204:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 104 00000100:00100000:3.0:1788581129.101211:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2375:x1875462995329280:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581129.101237:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2375:x1875462995329280:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 28us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581129.101268:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 104 00000100:00080000:3.0:1788581129.101285:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788581129.263504:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581129.327696:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014242176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581129.327767:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581129.328019:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014242176 00000100:00100000:3.0:1788581129.328027:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014242176 00000100:00100000:3.0:1788581129.328081:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788581129.328092:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f4370aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014242176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581129.328133:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788581129.328194:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f4370aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014242176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581129.328217:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788581129.328407:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190484fd180 x1875463014242176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581129.328427:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014242176:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788581130.290427:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581131.312448:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581131.375413:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581131.375442:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014242304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581131.375533:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581131.375606:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014242304 00000100:00100000:1.0:1788581131.375613:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014242304 00000100:00100000:1.0:1788581131.375686:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788581131.375696:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014242304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581131.375736:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581131.375785:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014242304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581131.375793:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788581131.375816:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788581131.375843:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c61d500 x1875463014242304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581131.375862:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014242304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788581132.335784:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788581133.005087:0:11516:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 00:05:30 (1788581130) === 00010000:00010000:1.0:1788581133.359679:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581133.367163:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581133.367952:0:5885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995329664 00000100:00100000:1.0:1788581133.367964:0:5885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995329664 00000100:00100000:1.0:1788581133.368048:0:5885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:1.0:1788581133.368060:0:5885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:9698:x1875462995329664:12345-192.168.201.13@tcp:700:mkdir.0 00000100:00100000:1.0:1788581133.368159:0:5885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:9698:x1875462995329664:12345-192.168.201.13@tcp:700:mkdir.0 Request processed in 102us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581133.368167:0:5885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00080000:3.0:1788581133.368362:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581133.373168:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581133.379373:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995329536 00000100:00100000:3.0:1788581133.379388:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995329536 00000100:00100000:3.0:1788581133.379507:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:3.0:1788581133.379517:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995329536:12345-192.168.201.13@tcp:41:mkdir.0 00000004:00000024:3.0:1788581133.379556:0:5878:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788581133.379673:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995329536:12345-192.168.201.13@tcp:41:mkdir.0 Request processed in 157us (6516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581133.379678:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:2.0:1788581133.384794:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581133.385002:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995329920 00000100:00100000:3.0:1788581133.385015:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995329920 00000100:00100000:3.0:1788581133.385085:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:3.0:1788581133.385098:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f4370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:9698:x1875462995329920:12345-192.168.201.13@tcp:36:mkdir.0 00010000:00010000:3.0:1788581133.385152:0:9658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581133.385237:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a6ffae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f3f expref: 6 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.386030:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525600) 00010000:00010000:3.0:1788581133.386043:0:9658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581133.386501:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a700cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.386516:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a700cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.386538:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a700cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.386591:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a700d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.386600:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a700d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.386607:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a700d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581133.387732:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788581133.387744:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a700cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.387753:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a700cd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.387760:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a700cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.387766:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581133.387770:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a700cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.387778:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a700cd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.387791:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919052341700) 00010000:00010000:3.0:1788581133.387794:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581133.387804:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a700cd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.387810:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a700cd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581133.387827:0:9658:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f50cfe7c reply state 000000007779806b transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a700d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581133.387836:0:9658:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788581133.388025:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f4370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:9698:x1875462995329920:12345-192.168.201.13@tcp:36:mkdir.0 Request processed in 2927us (3239us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788581133.388035:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 15 00010000:00010000:1.0:1788581133.391088:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a700d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.391105:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a700d4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.391113:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a700d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.391136:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581133.391141:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a700d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.391149:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a700d4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.391169:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff919052341d00) 00010000:00010000:1.0:1788581133.391173:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581133.391177:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a700d4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.391184:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a700d4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581133.410314:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581133.410800:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995330048 00000100:00100000:3.0:1788581133.410812:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995330048 00000100:00100000:3.0:1788581133.410889:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:3.0:1788581133.410969:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f4370b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:9700:x1875462995330048:12345-192.168.201.13@tcp:101:chmod.0 00010000:00010000:3.0:1788581133.410997:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581133.411022:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a700db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8fc4 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.411096:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a700e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.411111:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a700e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.411125:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a700e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581133.411163:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788581133.411181:0:5876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581133.411224:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a700e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.411568:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a700db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fc4 expref: 8 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.411589:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a700e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fc4 expref: 7 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.411598:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919052341700) 00010000:00010000:3.0:1788581133.411601:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581133.411604:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce600, rc 0) 00000100:00100000:3.0:1788581133.411726:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f4370b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:9700:x1875462995330048:12345-192.168.201.13@tcp:101:chmod.0 Request processed in 761us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581133.418356:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:3.0:1788581133.426882:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581133.427120:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995330304 00000100:00100000:2.0:1788581133.427146:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995330304 00000100:00100000:2.0:1788581133.427206:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:2.0:1788581133.427216:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:9700:x1875462995330304:12345-192.168.201.13@tcp:36:chmod.0 00010000:00010000:2.0:1788581133.427321:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581133.427353:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a700e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fc4 expref: 7 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581133.427374:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919052341700) 00010000:00010000:2.0:1788581133.427385:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581133.427413:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a700e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581133.427427:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a700e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581133.427438:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a700e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581133.427778:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000838644ac reply state 00000000425527a5 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a700e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581133.427788:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788581133.427795:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788581133.427904:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:9700:x1875462995330304:12345-192.168.201.13@tcp:36:chmod.0 Request processed in 688us (1043us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788581133.427912:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 17 00010000:00010000:2.0:1788581133.432114:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a700e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581133.432136:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a700e9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581133.432160:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a700e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581133.432165:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb82a00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581133.432170:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a700e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581133.432178:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a700e9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581133.432198:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525200) 00010000:00010000:2.0:1788581133.432202:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788581133.432206:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a700e9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581133.432212:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a700e9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581133.456856:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581133.457009:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995330432 00000100:00100000:2.0:1788581133.457021:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995330432 00000100:00100000:2.0:1788581133.457136:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:2.0:1788581133.457148:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:9701:x1875462995330432:12345-192.168.201.13@tcp:101:chown.0 00010000:00010000:2.0:1788581133.457177:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581133.457205:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a700f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8fcb expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581133.457320:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a700f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581133.457335:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a700f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581133.457362:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a700f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581133.457398:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788581133.457402:0:5878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788581133.457440:0:5878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a700f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581133.458056:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a700f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fcb expref: 9 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581133.458077:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a700f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fcb expref: 8 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581133.458085:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525200) 00010000:00010000:2.0:1788581133.458087:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788581133.458090:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb83000, rc 0) 00000100:00100000:2.0:1788581133.458165:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:9701:x1875462995330432:12345-192.168.201.13@tcp:101:chown.0 Request processed in 1018us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581133.458172:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:0.0:1788581133.464399:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581133.464602:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995330560 00000100:00100000:3.0:1788581133.464613:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995330560 00000100:00100000:3.0:1788581133.464677:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:3.0:1788581133.464689:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:9701:x1875462995330560:12345-192.168.201.13@tcp:101:chown.0 00010000:00010000:3.0:1788581133.464711:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581133.464733:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a700fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8fd2 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.464801:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70105 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.464834:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70105 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.464847:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70105 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.464864:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7010c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.464883:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7010c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.464891:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7010c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.464986:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70113 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.464995:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465003:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581133.465042:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788581133.465046:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581133.465073:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465087:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70105 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465104:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70105 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465112:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70105 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465119:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581133.465125:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70105 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465133:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70105 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465147:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525200) 00010000:00010000:3.0:1788581133.465149:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581133.465153:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70105 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465159:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70105 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465173:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7010c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465179:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7010c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465185:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7010c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465191:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581133.465204:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7010c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465210:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7010c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465217:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff919052341a00) 00010000:00010000:3.0:1788581133.465220:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581133.465223:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7010c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465228:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7010c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465295:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a700fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fd2 expref: 10 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465311:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70113 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fd2 expref: 9 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.465319:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919052341c00) 00010000:00010000:3.0:1788581133.465321:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581133.465324:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cee00, rc 0) 00000100:00100000:3.0:1788581133.465597:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:9701:x1875462995330560:12345-192.168.201.13@tcp:101:chown.0 Request processed in 909us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581133.465605:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:1.0:1788581133.482124:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581133.482190:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995330816 00000100:00100000:3.0:1788581133.482202:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995330816 00000100:00100000:3.0:1788581133.482384:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:3.0:1788581133.482396:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:9701:x1875462995330816:12345-192.168.201.13@tcp:36:chown.0 00010000:00010000:3.0:1788581133.482478:0:5876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581133.482506:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70113 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fd2 expref: 9 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.482525:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919052341c00) 00010000:00010000:3.0:1788581133.482534:0:5876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581133.482559:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7011a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.482572:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7011a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.482582:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7011a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788581133.576032:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:1.0:1788581133.576052:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788581133.576325:0:5876:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b819709a reply state 0000000066249efe transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7011a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581133.576340:0:5876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788581133.576363:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1788581133.576456:0:5876:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788581133.576479:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:9701:x1875462995330816:12345-192.168.201.13@tcp:36:chown.0 Request processed in 94081us (94361us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788581133.576488:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 20 00010000:00010000:1.0:1788581133.576542:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7011a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.576553:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7011a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.576561:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7011a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.576567:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581133.576571:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7011a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.576591:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7011a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.576611:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919052341a00) 00010000:00010000:1.0:1788581133.576614:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788581133.576619:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7011a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.576625:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7011a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581133.633044:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581133.633373:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995330944 00000100:00100000:3.0:1788581133.633384:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995330944 00000100:00100000:3.0:1788581133.633573:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:3.0:1788581133.633585:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:9702:x1875462995330944:12345-192.168.201.13@tcp:101:touch.500 00010000:00010000:3.0:1788581133.633611:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581133.633634:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8fd9 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788581133.643458:0:5877:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 9764us 00010000:00010000:3.0:1788581133.670539:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70128 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.670566:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70128 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.670597:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70128 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.670616:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a7012f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.670624:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a7012f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.670630:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a7012f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671154:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce800/0xf54e3944c2a70136 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671165:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce800/0xf54e3944c2a70136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671173:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce800/0xf54e3944c2a70136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581133.671198:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788581133.671202:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581133.671270:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce800/0xf54e3944c2a70136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671283:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70128 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671290:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70128 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671307:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70128 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671313:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581133.671317:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70128 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671324:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70128 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671337:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525200) 00010000:00010000:3.0:1788581133.671340:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581133.671344:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70128 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671350:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70128 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671361:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a7012f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671367:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a7012f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671373:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a7012f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671377:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581133.671380:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a7012f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671397:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a7012f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671406:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff919052341c00) 00010000:00010000:3.0:1788581133.671408:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581133.671411:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a7012f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671417:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a7012f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.671454:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fd9 expref: 8 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.672216:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce800/0xf54e3944c2a70136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fd9 expref: 7 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.672227:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919052341000) 00010000:00010000:3.0:1788581133.672230:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788581133.672233:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce800, rc 0) 00000100:00100000:3.0:1788581133.672350:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:9702:x1875462995330944:12345-192.168.201.13@tcp:101:touch.500 Request processed in 38766us (39316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581133.672360:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:1.0:1788581133.678235:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581133.678721:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995331200 00000100:00100000:3.0:1788581133.678731:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995331200 00000100:00100000:3.0:1788581133.678799:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:3.0:1788581133.678809:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:9702:x1875462995331200:12345-192.168.201.13@tcp:101:touch.500 00010000:00010000:3.0:1788581133.678843:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581133.678875:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7013d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8fe0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.679197:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70144 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.679211:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70144 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.679222:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70144 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.679454:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7014b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.679463:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7014b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.679470:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7014b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788581133.681226:0:5878:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788581133.681800:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a70152 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.681815:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a70152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.681825:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a70152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.681965:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70144 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.681974:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70144 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.681980:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70144 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.681985:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b3400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581133.681989:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70144 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.681996:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70144 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.682009:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919052341000) 00010000:00010000:3.0:1788581133.682012:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581133.682017:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70144 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.682022:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70144 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581133.682037:0:5878:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000faabc342 reply state 0000000078f109fa transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7014b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581133.682046:0:5878:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788581133.682085:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7013d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fe0 expref: 10 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.682114:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a70152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fe0 expref: 9 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.682121:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff919052341800) 00010000:00010000:3.0:1788581133.682123:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581133.682125:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413ff000, rc 0) 00000100:00100000:3.0:1788581133.682207:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+10:9702:x1875462995331200:12345-192.168.201.13@tcp:101:touch.500 Request processed in 3399us (3982us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788581133.682216:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 22 00010000:00010000:1.0:1788581133.686182:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7014b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.686197:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7014b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.686205:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7014b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.686211:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b2800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581133.686215:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7014b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.686222:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7014b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.686239:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff919052341200) 00010000:00010000:1.0:1788581133.686283:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581133.686289:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7014b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.686296:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7014b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581133.687733:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581133.688015:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995331456 00000100:00100000:0.0:1788581133.688028:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995331456 00000100:00100000:0.0:1788581133.688089:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00100000:0.0:1788581133.688100:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:9702:x1875462995331456:12345-192.168.201.13@tcp:36:touch.500 00010000:00010000:0.0:1788581133.688156:0:9658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581133.688185:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a70152 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fe0 expref: 9 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.688216:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff919052341800) 00010000:00010000:0.0:1788581133.688226:0:9658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581133.688419:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70160 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.688505:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.688517:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581133.688648:0:9658:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecd0de7f reply state 000000008b0542a6 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581133.688658:0:9658:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788581133.688751:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+10:9702:x1875462995331456:12345-192.168.201.13@tcp:36:touch.500 Request processed in 651us (1026us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788581133.688759:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 23 00010000:00010000:0.0:1788581133.693097:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.693116:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70160 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.693124:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70160 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.693129:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581133.693135:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70160 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.693159:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70160 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.693177:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91904995a800) 00010000:00010000:0.0:1788581133.693181:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581133.693185:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70160 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.693191:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70160 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581133.699072:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581133.699501:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995331584 00000100:00100000:0.0:1788581133.699512:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995331584 00000100:00100000:0.0:1788581133.699573:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 24 00000100:00100000:0.0:1788581133.699583:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:9702:x1875462995331584:12345-192.168.201.13@tcp:101:touch.500 00010000:00010000:0.0:1788581133.699607:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581133.699630:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70167 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8fe7 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.699692:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70167 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fe7 expref: 10 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.699706:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70167 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fe7 expref: 10 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.699724:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91904995a900) 00010000:00010000:0.0:1788581133.699727:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788581133.699731:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc23e00, rc 0) 00000100:00100000:0.0:1788581133.699805:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+10:9702:x1875462995331584:12345-192.168.201.13@tcp:101:touch.500 Request processed in 222us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581133.699813:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 24 00000100:00100000:3.0:1788581133.706179:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581133.706359:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995331712 00000100:00100000:2.0:1788581133.706371:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995331712 00000100:00100000:2.0:1788581133.706425:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:2.0:1788581133.706433:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2371:x1875462995331712:12345-192.168.201.13@tcp:8:touch.500 00010000:00080000:2.0:1788581133.706464:0:6723:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:2.0:1788581133.706495:0:6723:0:(genops.c:1385:class_connect()) connect: client 11f1870a-1d9b-4af2-bb25-e81f8742df75, cookie 0xf54e3944c2a7016e 00002000:00100000:2.0:1788581133.706507:0:6723:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 11f1870a-1d9b-4af2-bb25-e81f8742df75/ffff91907630b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788581133.706546:0:6723:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788581133.706787:0:6723:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788581133.706818:0:6723:0:(import.c:65:import_set_state_nolock()) ffff91907630f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581133.706899:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2371:x1875462995331712:12345-192.168.201.13@tcp:8:touch.500 Request processed in 465us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581133.706907:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:1.0:1788581133.709234:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581133.709402:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995331840 00000100:00100000:2.0:1788581133.709411:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995331840 00000100:00100000:2.0:1788581133.709520:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:2.0:1788581133.709531:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:0:x1875462995331840:12345-192.168.201.13@tcp:2:touch.500 00000100:00080000:3.0:1788581133.713834:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581133.760063:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:0:x1875462995331840:12345-192.168.201.13@tcp:2:touch.500 Request processed in 50521us (50824us total) trans 4294967299 rc 0/0 00000001:00080000:1.0:1788581133.760183:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1788581133.760196:0:6750:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11f1870a-1d9b-4af2-bb25-e81f8742df75 00000100:00100000:2.0:1788581133.760451:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:3.0:1788581133.772031:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581133.772173:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995332096 00000100:00100000:2.0:1788581133.772184:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995332096 00000100:00100000:2.0:1788581133.772488:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:2.0:1788581133.772499:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+10:9702:x1875462995332096:12345-192.168.201.13@tcp:35:touch.500 00000100:00100000:2.0:1788581133.772964:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+11:9702:x1875462995332096:12345-192.168.201.13@tcp:35:touch.500 Request processed in 466us (943us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788581133.772973:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:0.0:1788581133.812826:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581133.813925:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995332224 00000100:00100000:3.0:1788581133.813937:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995332224 00000100:00100000:3.0:1788581133.814002:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 25 00000100:00100000:3.0:1788581133.814014:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+11:9703:x1875462995332224:12345-192.168.201.13@tcp:101:rm.0 00010000:00010000:3.0:1788581133.814038:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581133.814058:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70175 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8fee expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.814119:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe800/0xf54e3944c2a7017c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.814132:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe800/0xf54e3944c2a7017c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.814144:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe800/0xf54e3944c2a7017c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581133.814189:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788581133.814192:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581133.814233:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe800/0xf54e3944c2a7017c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.814893:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70175 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fee expref: 13 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.814915:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe800/0xf54e3944c2a7017c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fee expref: 12 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.814924:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919052341000) 00010000:00010000:3.0:1788581133.814927:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581133.814930:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413fe800, rc 0) 00000100:00100000:3.0:1788581133.815053:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+12:9703:x1875462995332224:12345-192.168.201.13@tcp:101:rm.0 Request processed in 1040us (2235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581133.815060:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 25 00000100:00100000:0.0:1788581133.830977:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581133.831133:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995332480 00000100:00100000:3.0:1788581133.831144:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995332480 00000100:00100000:3.0:1788581133.831222:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 26 00000100:00100000:3.0:1788581133.831234:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+12:9703:x1875462995332480:12345-192.168.201.13@tcp:101:rm.0 00010000:00010000:3.0:1788581133.831301:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581133.831324:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70183 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8ff5 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581133.831449:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788581133.831625:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70183 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8ff5 expref: 14 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.831648:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525200) 00010000:00010000:3.0:1788581133.831650:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581133.831656:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70183 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8ff5 expref: 14 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.831673:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413ffc00, rc 0) 00000100:00100000:3.0:1788581133.831733:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:9703:x1875462995332480:12345-192.168.201.13@tcp:101:rm.0 Request processed in 502us (766us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1788581133.831742:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 26 00000100:00100000:1.0:1788581133.840726:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581133.840838:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995332608 00000100:00100000:2.0:1788581133.840851:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995332608 00000100:00100000:2.0:1788581133.840929:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:2.0:1788581133.840941:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:9703:x1875462995332608:12345-192.168.201.13@tcp:37:rm.0 00000100:00100000:2.0:1788581133.856152:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:9703:x1875462995332608:12345-192.168.201.13@tcp:37:rm.0 Request processed in 15202us (15428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581133.856180:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:1.0:1788581133.863582:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581133.870757:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995332864 00000100:00100000:0.0:1788581133.870776:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995332864 00000100:00100000:0.0:1788581133.870873:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:0.0:1788581133.870893:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904dc11850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:9703:x1875462995332864:12345-192.168.201.13@tcp:35:rm.0 00000100:00100000:0.0:1788581133.871182:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904dc11850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+14:9703:x1875462995332864:12345-192.168.201.13@tcp:35:rm.0 Request processed in 290us (9213us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788581133.871190:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:1.0:1788581133.882593:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581133.885636:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995333120 00000100:00100000:3.0:1788581133.885653:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995333120 00000100:00100000:3.0:1788581133.885735:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:3.0:1788581133.885745:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+14:9703:x1875462995333120:12345-192.168.201.13@tcp:101:rm.0 00010000:00010000:3.0:1788581133.885769:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581133.885791:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70191 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d8ffc expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.885896:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a70198 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.885910:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a70198 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.885920:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a70198 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581133.885930:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788581133.886064:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70191 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8ffc expref: 17 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.886085:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a70198 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8ffc expref: 16 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.886093:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919052341000) 00010000:00010000:3.0:1788581133.886095:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788581133.886098:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413fe200, rc 0) 00000100:00100000:3.0:1788581133.886169:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+16:9703:x1875462995333120:12345-192.168.201.13@tcp:101:rm.0 Request processed in 426us (3589us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788581133.886175:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:3.0:1788581133.909808:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581133.909975:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995333248 00000100:00100000:0.0:1788581133.909985:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995333248 00000100:00100000:0.0:1788581133.910042:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 28 00000100:00100000:0.0:1788581133.910051:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+16:9703:x1875462995333248:12345-192.168.201.13@tcp:41:rm.0 00000004:00000024:0.0:1788581133.910107:0:5876:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1788581133.910175:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+16:9703:x1875462995333248:12345-192.168.201.13@tcp:41:rm.0 Request processed in 125us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581133.910182:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 28 00000100:00100000:1.0:1788581133.914605:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581133.914742:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995333376 00000100:00100000:3.0:1788581133.914754:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995333376 00000100:00100000:3.0:1788581133.914855:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 29 00000100:00100000:3.0:1788581133.914875:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+16:9703:x1875462995333376:12345-192.168.201.13@tcp:101:rm.0 00010000:00010000:3.0:1788581133.914905:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581133.914928:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a701a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9003 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.914993:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a701ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915008:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a701ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915019:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a701ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915051:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a701b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915059:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a701b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915066:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a701b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915174:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a701bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915183:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a701bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915191:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a701bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581133.915233:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788581133.915237:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581133.915301:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a701bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915315:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a701bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915324:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a701ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915341:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a701ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915360:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a701ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915366:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413ff200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581133.915371:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a701ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915379:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a701ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915392:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919052341000) 00010000:00010000:3.0:1788581133.915395:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581133.915399:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a701ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915406:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a701ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915422:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a701b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915428:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a701b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915434:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a701b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915439:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413fec00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581133.915441:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a701b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915460:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a701b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915468:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff919052341c00) 00010000:00010000:3.0:1788581133.915471:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581133.915474:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a701b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915488:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a701b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915524:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a701a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9003 expref: 18 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915539:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a701bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9003 expref: 17 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.915547:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91904995a900) 00010000:00010000:3.0:1788581133.915550:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581133.915552:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413ff000, rc 0) 00000100:00100000:3.0:1788581133.915618:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+17:9703:x1875462995333376:12345-192.168.201.13@tcp:101:rm.0 Request processed in 745us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581133.915626:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 29 00000100:00100000:3.0:1788581133.937333:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581133.937354:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014242560:0@lo:400:kworker.0 00000100:00100000:1.0:1788581133.937404:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581133.937462:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995333632 00000100:00100000:1.0:1788581133.937464:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014243072:0@lo:400:kworker.0 00000100:00100000:3.0:1788581133.937470:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995333632 00000100:00100000:1.0:1788581133.937510:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581133.937526:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014242560 00000100:00100000:3.0:1788581133.937528:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014242560 00000100:00100000:1.0:1788581133.937540:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581133.937546:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014242688:0@lo:400:kworker.0 00000100:00100000:3.0:1788581133.937560:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788581133.937569:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014242560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581133.937570:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581133.937609:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014242688 00000100:00100000:1.0:1788581133.937613:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014242688 00000100:00100000:3.0:1788581133.937625:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014242560:12345-0@lo:400:kworker.0 Request processed in 58us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581133.937633:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788581133.937640:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014242560:0@lo:400:kworker.0 00000100:00100000:3.0:1788581133.937651:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 30 00000100:00100000:3.0:1788581133.937657:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+17:9703:x1875462995333632:12345-192.168.201.13@tcp:36:rm.0 00000100:00100000:1.0:1788581133.937678:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788581133.937683:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014242688:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1788581133.937703:0:5878:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00000100:00100000:1.0:1788581133.937722:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014242688:12345-0@lo:400:kworker.0 Request processed in 39us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581133.937727:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00010000:3.0:1788581133.937729:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a701bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9003 expref: 17 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581133.937748:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014242688:0@lo:400:kworker.0 00010000:00010000:3.0:1788581133.937750:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70167 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fe7 expref: 16 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.937761:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91904995a900) 00010000:00010000:3.0:1788581133.937976:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe800/0xf54e3944c2a7017c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fee expref: 15 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581133.937988:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919052341000) 00010000:00010000:3.0:1788581133.937991:0:5878:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581133.938081:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a701c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.938097:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a701c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.938107:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a701c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.938120:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a701c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.938127:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a701c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.938133:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a701c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581133.938376:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014242432:0@lo:400:kworker.0 00000100:00100000:2.0:1788581133.938414:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581133.938439:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3339:1875463014242944:0@lo:400:kworker.0 00000100:00100000:2.0:1788581133.938463:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581133.938484:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581133.938491:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014242816:0@lo:400:kworker.0 00000100:00100000:2.0:1788581133.938514:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581133.938548:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014243072 00000100:00100000:2.0:1788581133.938555:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014243072 00000100:00100000:2.0:1788581133.938586:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014242816 00000100:00100000:2.0:1788581133.938589:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014242816 00000100:00100000:2.0:1788581133.938612:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788581133.938619:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014243072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581133.938659:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014243072:12345-0@lo:400:kworker.0 Request processed in 41us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581133.938666:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788581133.938680:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788581133.938686:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f4370bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014242816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581133.938717:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f4370bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014242816:12345-0@lo:400:kworker.0 Request processed in 32us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581133.938724:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1788581133.938757:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190768b6a00 x1875463014242816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581133.938768:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014242816:0@lo:400:kworker.0 00010000:00080000:2.0:1788581133.938803:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190768b6d80 x1875463014243072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581133.938812:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014243072:0@lo:400:kworker.0 00000100:00080000:2.0:1788581133.938834:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788581133.938838:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581133.938840:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581133.938848:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014242944 00000100:00100000:2.0:1788581133.938851:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014242944 00000100:00080000:2.0:1788581133.938874:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581133.938903:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014242432 00000100:00100000:3.0:1788581133.938908:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014242432 00000100:00100000:3.0:1788581133.938934:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788581133.938940:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3339:x1875463014242432:12345-0@lo:400:kworker.0 00010000:00010000:1.0:1788581133.939515:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a701d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.939529:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a701d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.939538:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a701d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581133.940359:0:5878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788581133.940371:0:5878:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 350181127171ns, next at 351181124828ns, rc = 0 00010000:00010000:1.0:1788581133.940431:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a701d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940441:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a701d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940449:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a701d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940455:0:5878:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a701d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940461:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a701d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940467:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a701d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940482:0:5878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581133.940505:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a701d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940512:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a701d0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940517:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a701d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940523:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581133.940533:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a701d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940541:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a701d0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940553:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91905c6f1a00) 00010000:00010000:1.0:1788581133.940556:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788581133.940560:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a701d0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940567:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a701d0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940584:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a701c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940590:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a701c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940595:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a701c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940600:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9e00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581133.940603:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a701c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940608:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a701c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940616:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919052341000) 00010000:00010000:1.0:1788581133.940618:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581133.940627:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a701c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581133.940633:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a701c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788581133.940644:0:5878:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000244af286 reply state 000000008d111b03 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a701c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581133.940653:0:5878:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788581133.940738:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+16:9703:x1875462995333632:12345-192.168.201.13@tcp:36:rm.0 Request processed in 3077us (3408us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788581133.940746:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 30 00010000:00010000:0.0:1788581133.942393:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581133.942405:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a701d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.942415:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8e00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581133.942419:0:5865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a701d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.942445:0:5865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a701d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.942461:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91905c6f1a00) 00010000:00010000:0.0:1788581133.942464:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788581133.942468:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a701d7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.942475:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a701d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.942496:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581133.942499:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581133.942501:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581133.946635:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3339:x1875463014242432:12345-0@lo:400:kworker.0 Request processed in 7680us (8206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581133.946660:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00010000:00010000:0.0:1788581133.946755:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a701c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.946769:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a701c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.946779:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a701c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.946785:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9c00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581133.946793:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a701c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.946802:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a701c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.946819:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff91905c6f1200) 00010000:00010000:0.0:1788581133.946830:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581133.946836:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a701c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.946844:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a701c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581133.947049:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014242432:0@lo:400:kworker.0 00000100:00100000:2.0:1788581133.947160:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788581133.947174:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3339:x1875463014242944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581133.947286:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3339:x1875463014242944:12345-0@lo:400:kworker.0 Request processed in 117us (8821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581133.947294:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788581133.947991:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3339:1875463014242944:0@lo:400:kworker.0 00000100:00100000:3.0:1788581133.952430:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581133.952591:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995333888 00000100:00100000:2.0:1788581133.952603:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995333888 00000100:00100000:2.0:1788581133.952661:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:2.0:1788581133.952673:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+15:9703:x1875462995333888:12345-192.168.201.13@tcp:35:rm.0 00000100:00100000:2.0:1788581133.953158:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+16:9703:x1875462995333888:12345-192.168.201.13@tcp:35:rm.0 Request processed in 485us (738us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788581133.953167:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:1.0:1788581133.968520:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581133.968620:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995334144 00000100:00100000:0.0:1788581133.968630:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995334144 00000100:00100000:0.0:1788581133.968694:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 31 00000100:00100000:0.0:1788581133.968705:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+16:9703:x1875462995334144:12345-192.168.201.13@tcp:36:rm.0 00010000:00010000:0.0:1788581133.968769:0:5876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788581133.968797:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a70198 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8ffc expref: 16 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.968819:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce800/0xf54e3944c2a70136 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fd9 expref: 15 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.968831:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919052341000) 00010000:00010000:0.0:1788581133.968848:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a700f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fcb expref: 14 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.968866:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525200) 00010000:00010000:0.0:1788581133.968874:0:5876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581133.968900:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23000/0xf54e3944c2a701de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.968913:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23000/0xf54e3944c2a701de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.968942:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23000/0xf54e3944c2a701de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.968955:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23200/0xf54e3944c2a701e5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.968962:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23200/0xf54e3944c2a701e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.968969:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23200/0xf54e3944c2a701e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.969491:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22000/0xf54e3944c2a701ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.969502:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22000/0xf54e3944c2a701ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.969509:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22000/0xf54e3944c2a701ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581133.970109:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788581133.970129:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22000/0xf54e3944c2a701ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.970137:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22000/0xf54e3944c2a701ec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.970143:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22000/0xf54e3944c2a701ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.970148:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581133.970159:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22000/0xf54e3944c2a701ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.970167:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22000/0xf54e3944c2a701ec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.970179:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91904995ab00) 00010000:00010000:0.0:1788581133.970182:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788581133.970186:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22000/0xf54e3944c2a701ec lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.970192:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22000/0xf54e3944c2a701ec lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.973585:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23000/0xf54e3944c2a701de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.973595:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23000/0xf54e3944c2a701de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.973602:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23000/0xf54e3944c2a701de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.973608:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581133.973612:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23000/0xf54e3944c2a701de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.973620:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23000/0xf54e3944c2a701de lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.973634:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91904995a800) 00010000:00010000:0.0:1788581133.973637:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581133.973659:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23000/0xf54e3944c2a701de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581133.973665:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23000/0xf54e3944c2a701de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581133.973679:0:5876:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6f5cefe reply state 00000000cc15b099 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23200/0xf54e3944c2a701e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581133.973688:0:5876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788581133.982175:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+15:9703:x1875462995334144:12345-192.168.201.13@tcp:36:rm.0 Request processed in 13459us (13652us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788581133.982189:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 31 00010000:00010000:0.0:1788581134.001994:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23200/0xf54e3944c2a701e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581134.002014:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23200/0xf54e3944c2a701e5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581134.002022:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23200/0xf54e3944c2a701e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581134.002028:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581134.002032:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23200/0xf54e3944c2a701e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581134.002038:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23200/0xf54e3944c2a701e5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581134.002055:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91904995ac00) 00010000:00010000:0.0:1788581134.002057:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581134.002062:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23200/0xf54e3944c2a701e5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581134.002069:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23200/0xf54e3944c2a701e5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581134.216314:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581134.216381:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581134.216488:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995334272 00000100:00100000:2.0:1788581134.216500:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995334272 00000100:00100000:2.0:1788581134.216571:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 252 00000100:00100000:2.0:1788581134.216583:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2375:x1875462995334272:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581134.216666:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2375:x1875462995334272:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 85us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581134.216674:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 252 00000100:00100000:0.0:1788581134.216989:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995334400 00000100:00100000:0.0:1788581134.216995:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995334400 00000100:00100000:0.0:1788581134.217063:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 108 00000100:00100000:0.0:1788581134.217070:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2375:x1875462995334400:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581134.217123:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2375:x1875462995334400:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 53us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581134.217130:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 108 00000100:00080000:2.0:1788581134.218989:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788581134.383756:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581134.447534:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014243200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581134.447608:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581134.447824:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014243200 00000100:00100000:3.0:1788581134.447832:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014243200 00000100:00100000:3.0:1788581134.447933:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788581134.447943:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f4370a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014243200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581134.447977:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788581134.448031:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f4370a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014243200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581134.448037:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788581134.448105:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076884e00 x1875463014243200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581134.448123:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014243200:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788581135.412572:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581136.433470:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788581136.495589:0:6821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352736342592ns, next at 353736339705ns, rc = 0 00000100:00100000:3.0:1788581136.495716:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581136.495742:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014243328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581136.495870:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581136.496040:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014243328 00000100:00100000:0.0:1788581136.496049:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014243328 00000100:00100000:0.0:1788581136.496123:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788581136.496135:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014243328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581136.496176:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788581136.496350:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788581136.496404:0:3339:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919075e91f80 x1875463014243328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581136.496456:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014243328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 322us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581136.496464:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788581136.496502:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014243328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788581137.456574:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581138.480771:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788581138.633357:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1788581138.633381:0:5899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:1.0:1788581138.633399:0:5899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788581138.633587:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581138.633609:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014243456:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788581138.633682:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581138.633791:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014243456 00000100:00100000:3.0:1788581138.633799:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014243456 00000100:00080000:2.0:1788581138.633856:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581138.633875:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788581138.633885:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014243456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788581138.633912:0:6725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788581138.633944:0:6725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9b950d, atime: 0x6a9b950d, ctime: 0x6a9b950d, blocks: 0x1 00010000:00010000:3.0:1788581138.633952:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004190064c/0xf54e3944c2a701f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581138.633969:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=354s v=(0 0) 00010000:00010000:3.0:1788581138.633997:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581138.634005:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004190064c/0xf54e3944c2a701f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581138.634025:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004190064c/0xf54e3944c2a701f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581138.634034:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004190064c/0xf54e3944c2a701f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581138.634052:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004190064c/0xf54e3944c2a701f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581138.634072:0:6725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581138.634147:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581138.634154:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004190064c/0xf54e3944c2a701f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581138.634161:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413ffc00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:2.0:1788581138.634166:0:5865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004190064c/0xf54e3944c2a701f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581138.634186:0:5865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004190064c/0xf54e3944c2a701f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581138.634215:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004190064c/0xf54e3944c2a701f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581138.634223:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004190064c/0xf54e3944c2a701f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581138.634270:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581138.634272:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581138.634274:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581138.635029:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014243456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1142us (1344us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788581138.635038:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1788581138.635319:0:3338:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff919076884380/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788581138.635329:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014243456:0@lo:6:osp-syn-0-0.0 00000001:02000400:1.0:1788581138.850616:0:11669:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1788581139.056035:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014243584:0@lo:400:kworker.0 00000100:00100000:0.0:1788581139.056114:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581139.056178:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014244096:0@lo:400:kworker.0 00000100:00100000:0.0:1788581139.056206:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581139.056237:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788581139.056277:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014243712:0@lo:400:kworker.0 00000100:00100000:0.0:1788581139.056301:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581139.056320:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014244224:0@lo:400:kworker.0 00000100:00100000:0.0:1788581139.056344:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581139.056396:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014243840:0@lo:400:kworker.0 00000100:00100000:0.0:1788581139.056419:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581139.056444:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581139.056450:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014243968:0@lo:400:kworker.0 00000100:00100000:0.0:1788581139.056471:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581139.056507:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014243584 00000100:00100000:0.0:1788581139.056514:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014243584 00000100:00100000:0.0:1788581139.056564:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788581139.056574:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014243584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581139.056625:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014243584:12345-0@lo:400:kworker.0 Request processed in 53us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581139.056633:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788581139.056665:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014244224 00000100:00100000:0.0:1788581139.056668:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014244224 00000100:00100000:0.0:1788581139.056701:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014243968 00000100:00100000:0.0:1788581139.056704:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014243968 00000100:00100000:0.0:1788581139.056721:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788581139.056727:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014244224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581139.056757:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014244224:12345-0@lo:400:kworker.0 Request processed in 31us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581139.056763:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788581139.056785:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788581139.056791:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014243968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581139.056822:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014243968:12345-0@lo:400:kworker.0 Request processed in 31us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581139.056828:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788581139.056842:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014244096 00000100:00100000:0.0:1788581139.056852:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014244096 00000100:00100000:0.0:1788581139.056879:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014243712 00000100:00100000:0.0:1788581139.056882:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014243712 00000100:00100000:0.0:1788581139.056894:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014243840 00000100:00100000:0.0:1788581139.056897:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014243840 00000100:00100000:0.0:1788581139.056910:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788581139.056916:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014244096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581139.056944:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014244096:12345-0@lo:400:kworker.0 Request processed in 28us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581139.056949:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788581139.056960:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788581139.056965:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014243712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581139.056987:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014243712:12345-0@lo:400:kworker.0 Request processed in 22us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581139.056992:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788581139.057002:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788581139.057007:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014243840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581139.057033:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014243840:12345-0@lo:400:kworker.0 Request processed in 26us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581139.057038:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1788581139.057061:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788581139.057066:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581139.057104:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014243968:0@lo:400:kworker.0 00000100:00100000:0.0:1788581139.057115:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014243840:0@lo:400:kworker.0 00000100:00100000:0.0:1788581139.057144:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014243712:0@lo:400:kworker.0 00010000:00080000:0.0:1788581139.057156:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906ca94380 x1875463014244224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581139.057173:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014244224:0@lo:400:kworker.0 00000100:00100000:0.0:1788581139.057185:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014243584:0@lo:400:kworker.0 00000100:00100000:0.0:1788581139.057196:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014244096:0@lo:400:kworker.0 00000001:00080000:1.0:1788581139.098766:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:1.0:1788581139.334179:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581139.334269:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995334528 00000100:00100000:3.0:1788581139.334280:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995334528 00000100:00100000:3.0:1788581139.334398:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 254 00000100:00100000:3.0:1788581139.334410:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995334528:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581139.334492:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995334528:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 85us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581139.334500:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 254 00000100:00100000:1.0:1788581139.360473:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581139.360535:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995334656 00000100:00100000:1.0:1788581139.360544:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995334656 00000100:00100000:1.0:1788581139.360621:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 112 00000100:00100000:1.0:1788581139.360632:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995334656:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581139.360712:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995334656:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581139.360720:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 112 00000100:00080000:1.0:1788581139.360742:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581139.360782:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581139.360914:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581139.360937:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995334912 00000100:00100000:1.0:1788581139.360942:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995334912 00000100:00100000:1.0:1788581139.360973:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 113 00000100:00100000:1.0:1788581139.360979:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2375:x1875462995334912:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581139.361010:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2375:x1875462995334912:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 31us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581139.361016:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 113 00000100:00100000:1.0:1788581139.361033:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995334784 00000100:00100000:1.0:1788581139.361037:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995334784 00000100:00100000:1.0:1788581139.361064:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 62 00000100:00100000:1.0:1788581139.361070:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2375:x1875462995334784:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581139.361096:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2375:x1875462995334784:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 26us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581139.361102:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 62 00000100:00080000:1.0:1788581139.361114:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581139.361116:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788581139.508979:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581139.567611:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014244352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581139.567706:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581139.572320:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014244352 00000100:00100000:3.0:1788581139.572338:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014244352 00000100:00100000:0.0:1788581139.573774:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788581139.573789:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014244352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788581139.573829:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581139.573940:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014244352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (6234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581139.573948:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788581139.574033:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907b96e680 x1875463014244352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581139.574055:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014244352:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1788581140.137467:0:11719:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd819c1f10 20000000:00000080:3.0:1788581140.137487:0:11719:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff918f425b2000 uarg=0000000000000000 20000000:01000000:3.0:1788581140.137522:0:11719:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788581140.137527:0:11719:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788581140.137532:0:11719:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788581140.138226:0:11720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788581140.138470:0:11719:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788581140.142623:0:11719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788581140.142682:0:11719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788581140.142731:0:11719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788581140.142749:0:11719:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788581140.142860:0:11719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9190413ff000/0xf54e3944c2a701fa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.142879:0:11719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190821cf800/0xf54e3944c2a7009c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a70095 expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.142887:0:11719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190821cf000/0xf54e3944c2a700aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a700a3 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.142895:0:11719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190821ce000/0xf54e3944c2a700b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a700b1 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.142905:0:11719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190821cec00/0xf54e3944c2a700bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fb6 expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.142912:0:11719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a700c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fbd expref: 12 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.142920:0:11719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9190413ff000/0xf54e3944c2a701fa lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.142958:0:11719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a700c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fbd expref: 12 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.142980:0:11719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a700c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fbd expref: 12 pid: 5870 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581140.142997:0:11719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11719:1875463014244480:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581140.143105:0:11719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190821cec00/0xf54e3944c2a700bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fb6 expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.143114:0:11719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9190821cec00/0xf54e3944c2a700bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fb6 expref: 12 pid: 5871 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581140.143122:0:11719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11719:1875463014244608:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581140.143147:0:11719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190821ce000/0xf54e3944c2a700b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a700b1 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.143155:0:11719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9190821ce000/0xf54e3944c2a700b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a700b1 expref: 18 pid: 5871 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581140.143174:0:11719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11719:1875463014244736:0@lo:104: 00000100:00100000:3.0:1788581140.143212:0:11719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581140.143279:0:11719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190821cf000/0xf54e3944c2a700aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a700a3 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.143288:0:11719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9190821cf000/0xf54e3944c2a700aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a700a3 expref: 18 pid: 5871 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581140.143297:0:11719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11719:1875463014244864:0@lo:104: 00000100:00100000:3.0:1788581140.143318:0:11719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581140.143355:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014244736 00000100:00100000:3.0:1788581140.143362:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014244736 00000100:00100000:3.0:1788581140.143394:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014244864 00000100:00100000:3.0:1788581140.143396:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014244864 00000100:00100000:3.0:1788581140.143407:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788581140.143414:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+4:11719:x1875463014244736:12345-0@lo:104: 00010000:00010000:3.0:1788581140.143425:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a700b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a700b8 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.143464:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788581140.143471:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+4:11719:x1875463014244736:12345-0@lo:104: Request processed in 57us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581140.143477:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788581140.143493:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788581140.143499:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:11719:x1875463014244864:12345-0@lo:104: 00010000:00010000:3.0:1788581140.143506:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a700a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a700aa expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.143534:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788581140.143540:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:11719:x1875463014244864:12345-0@lo:104: Request processed in 42us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581140.143545:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788581140.143561:0:6738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581140.143567:0:6738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a700b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a700b8 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.143575:0:6738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce400 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:3.0:1788581140.143579:0:6738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a700b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a700b8 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.143597:0:6738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a700b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a700b8 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581140.143605:0:6738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a700b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a700b8 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581140.143611:0:6738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788581140.143637:0:6738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a700b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a700b8 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.143644:0:6738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581140.143663:0:6738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a700b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a700b8 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.143670:0:6738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff9190821ce400/0xf54e3944c2a700b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a700b8 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.143683:0:6738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581140.143686:0:6738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a700a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a700aa expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.143691:0:6738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cfa00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:3.0:1788581140.143694:0:6738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a700a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a700aa expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.143699:0:6738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a700a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a700aa expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581140.143704:0:6738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a700a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a700aa expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581140.143715:0:6738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788581140.143726:0:6738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a700a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a700aa expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.143731:0:6738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581140.143742:0:6738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a700a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a700aa expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.143747:0:6738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff9190821cfa00/0xf54e3944c2a700a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a700aa expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.143767:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581140.143768:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581140.143770:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581140.143989:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581140.144085:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014245120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581140.144117:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581140.144659:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581140.144673:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014244992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581140.144703:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581140.144741:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014245120 00000100:00100000:0.0:1788581140.144747:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014245120 00010000:00010000:0.0:1788581140.144797:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190821cf000/0xf54e3944c2a700aa lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a700a3 expref: 19 pid: 5871 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581140.144821:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014244992 00000100:00100000:0.0:1788581140.144824:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014244992 00010000:00010000:0.0:1788581140.144850:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190821ce000/0xf54e3944c2a700b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a700b1 expref: 20 pid: 5871 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581140.144869:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581140.144876:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+20:3340:x1875463014245120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581140.144887:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581140.144891:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190821cf000/0xf54e3944c2a700aa lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a700a3 expref: 20 pid: 5871 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.144901:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190821cf000/0xf54e3944c2a700aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a700a3 expref: 20 pid: 5871 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.144918:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581140.144953:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+20:3340:x1875463014245120:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581140.144960:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581140.144975:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788581140.144982:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3338:x1875463014244992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581140.144989:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581140.144993:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190821ce000/0xf54e3944c2a700b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a700b1 expref: 19 pid: 5871 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.145000:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190821ce000/0xf54e3944c2a700b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a700b1 expref: 19 pid: 5871 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.145009:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581140.145036:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3338:x1875463014244992:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581140.145043:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788581140.145086:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014244992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581140.145114:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014245120:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581140.147800:0:11719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190821cf800/0xf54e3944c2a7009c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a70095 expref: 18 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581140.147818:0:11719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9190821cf800/0xf54e3944c2a7009c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a70095 expref: 18 pid: 5870 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581140.147834:0:11719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f4370b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11719:1875463014245248:0@lo:104: 00000100:00100000:2.0:1788581140.147907:0:11719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581140.147948:0:11719:0:(client.c:2715:ptlrpc_set_wait()) set ffff919041377e40 going to sleep for 11 seconds 00010000:00010000:2.0:1788581140.147975:0:11719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190821ce000/0xf54e3944c2a700b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a700b1 expref: 18 pid: 5871 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581140.148013:0:11719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11719:1875463014244736:0@lo:104: 00010000:00010000:2.0:1788581140.148026:0:11719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190821cf000/0xf54e3944c2a700aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a700a3 expref: 17 pid: 5871 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581140.148033:0:11719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11719:1875463014244864:0@lo:104: 00000100:00100000:0.0:1788581140.148182:0:5859:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788581140.148195:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014245248 00000100:00100000:0.0:1788581140.148201:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014245248 00000100:00100000:0.0:1788581140.148275:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788581140.148284:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:11719:x1875463014245248:12345-0@lo:104: 00010000:00010000:0.0:1788581140.148297:0:5859:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a70095 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a7009c expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.148351:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581140.148356:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+3:11719:x1875463014245248:12345-0@lo:104: Request processed in 74us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581140.148362:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788581140.148404:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581140.148411:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a70095 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a7009c expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.148418:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9a00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:0.0:1788581140.148422:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a70095 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a7009c expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.148430:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a70095 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a7009c expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581140.148438:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a70095 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a7009c expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581140.148444:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788581140.148477:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a70095 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a7009c expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.148484:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581140.148502:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a70095 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a7009c expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.148509:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919044ca9a00/0xf54e3944c2a70095 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a7009c expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.148524:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581140.148526:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581140.148527:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581140.148538:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014245376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581140.148566:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581140.148602:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014245376 00000100:00100000:0.0:1788581140.148605:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014245376 00010000:00010000:0.0:1788581140.148621:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190821cf800/0xf54e3944c2a7009c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a70095 expref: 17 pid: 5870 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581140.148640:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788581140.148646:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:3341:x1875463014245376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581140.148654:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581140.148659:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190821cf800/0xf54e3944c2a7009c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a70095 expref: 17 pid: 5870 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.148669:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190821cf800/0xf54e3944c2a7009c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a70095 expref: 17 pid: 5870 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.148684:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581140.148718:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:3341:x1875463014245376:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581140.148724:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788581140.148894:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014245376:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581140.148978:0:11719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190821cf800/0xf54e3944c2a7009c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a70095 expref: 16 pid: 5870 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581140.148988:0:11719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f4370b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11719:1875463014245248:0@lo:104: 00000100:00100000:2.0:1788581140.149658:0:11719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11719:1875463014244480:192.168.201.13@tcp:104: 00000100:00100000:2.0:1788581140.149668:0:11719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11719:1875463014244608:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581140.149697:0:11719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9190413ff000/0xf54e3944c2a701fa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581140.155490:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581140.155525:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581140.155650:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995335040 00000100:00100000:0.0:1788581140.155660:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995335040 00010000:00010000:0.0:1788581140.155701:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a700c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fbd expref: 13 pid: 5870 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581140.155731:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995335168 00000100:00100000:0.0:1788581140.155735:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995335168 00010000:00010000:0.0:1788581140.155748:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190821cec00/0xf54e3944c2a700bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fb6 expref: 14 pid: 5871 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581140.155791:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:0.0:1788581140.155801:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+14:2374:x1875462995335040:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581140.155815:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581140.155821:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a700c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fbd expref: 14 pid: 5870 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.155834:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a700c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fbd expref: 14 pid: 5870 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.155851:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a700c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fbd expref: 14 pid: 5870 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.155868:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581140.155924:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995335040:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 125us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581140.155949:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:0.0:1788581140.155967:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00100000:0.0:1788581140.155974:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:2375:x1875462995335168:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581140.155981:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581140.155987:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190821cec00/0xf54e3944c2a700bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fb6 expref: 12 pid: 5871 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.155996:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190821cec00/0xf54e3944c2a700bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fb6 expref: 12 pid: 5871 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.156005:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190821cec00/0xf54e3944c2a700bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8fb6 expref: 12 pid: 5871 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.156017:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9190413ff000/0xf54e3944c2a701fa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.156026:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190413ff000/0xf54e3944c2a701fa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.156042:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9190413ff000/0xf54e3944c2a701fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.156049:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9190413ff000/0xf54e3944c2a701fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.156056:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9190413ff000/0xf54e3944c2a701fa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.156063:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9190413ff000/0xf54e3944c2a701fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.156075:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413ff000 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581140.156080:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9190413ff000/0xf54e3944c2a701fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.156088:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9190413ff000/0xf54e3944c2a701fa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.156100:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9190413ff000/0xf54e3944c2a701fa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581140.156111:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581140.156133:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+11:2375:x1875462995335168:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 158us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581140.156139:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 34 00010000:00010000:2.0:1788581140.156544:0:11719:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9190413ff000/0xf54e3944c2a701fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581140.156553:0:11719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9190413ff000/0xf54e3944c2a701fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581140.156558:0:11719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190413ff000/0xf54e3944c2a701fa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581140.529050:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788581141.231498:0:5874:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788581141.231507:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91907f8f1000 from 7 10000000:01000000:2.0:1788581141.231513:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788581141.231574:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb82000/0xf54e3944c2a70201 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581141.231606:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91907bb82000/0xf54e3944c2a70201 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581141.231618:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91907bb82000/0xf54e3944c2a70201 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581141.231646:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f4370b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014245504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788581141.231718:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581141.231802:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014245504 00000100:00100000:0.0:1788581141.231811:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014245504 00000100:00100000:2.0:1788581141.231823:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c4600 going to sleep for 11 seconds 00000100:00100000:0.0:1788581141.231923:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788581141.231935:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904730d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:5874:x1875463014245504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581141.231950:0:5870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581141.231965:0:5870:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a70208 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a70201 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581141.232007:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a70208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a70201 expref: 17 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581141.232019:0:5870:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a70208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a70201 expref: 17 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581141.232029:0:5870:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22a00, rc 0) 00000100:00100000:0.0:1788581141.232110:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904730d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014245504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581141.232117:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788581141.232216:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f4370b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014245504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581141.232231:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91907bb82000/0xf54e3944c2a70201 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70208 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581141.232260:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91907bb82000/0xf54e3944c2a70201 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a70208 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581141.232314:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f4370b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014245632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581141.232339:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581141.232931:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014245632 00000100:00100000:3.0:1788581141.232937:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014245632 00000100:00100000:2.0:1788581141.232941:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c4600 going to sleep for 11 seconds 00000100:00100000:0.0:1788581141.233000:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788581141.233009:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014245632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581141.233529:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014245632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 520us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581141.233538:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788581141.233654:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f4370b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014245632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581141.233689:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f4370b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014245760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581141.233729:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581141.233808:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788581141.233826:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014245760 00000100:00100000:3.0:1788581141.233833:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014245760 00000100:00100000:3.0:1788581141.233854:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788581141.233861:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014245760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581141.234703:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014245760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 838us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581141.234713:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788581141.234794:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f4370b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014245760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581141.236994:0:11732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075e92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:11732:1875463014245888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581141.237085:0:11732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581141.237139:0:11732:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f43587780 going to sleep for 11 seconds 00000100:00100000:0.0:1788581141.237532:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014245888 00000100:00100000:0.0:1788581141.237541:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014245888 00000100:00100000:0.0:1788581141.237590:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788581141.237601:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:11732:x1875463014245888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581141.237891:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:11732:x1875463014245888:12345-0@lo:502:llog_process_th.0 Request processed in 291us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581141.237899:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788581141.244629:0:11732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075e92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:11732:1875463014245888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788581141.244687:0:11732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581141.244701:0:11732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581141.244703:0:11732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788581141.244712:0:11732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91907f8f1000 00000020:00000080:1.0:1788581141.244715:0:11732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788581141.244844:0:11732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075e92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:11732:1875463014246016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581141.244924:0:11732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581141.245050:0:11732:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f43587780 going to sleep for 11 seconds 00000100:00100000:2.0:1788581141.247926:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014246016 00000100:00100000:2.0:1788581141.247949:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014246016 00000100:00100000:2.0:1788581141.248043:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788581141.248054:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:11732:x1875463014246016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581141.248319:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:11732:x1875463014246016:12345-0@lo:502:llog_process_th.0 Request processed in 267us (3395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581141.248328:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788581141.248433:0:11732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075e92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:11732:1875463014246016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788581141.248465:0:11732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581141.248472:0:11732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581141.248475:0:11732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788581141.248481:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788581141.248619:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788581141.248650:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581141.248660:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb82000/0xf54e3944c2a70201 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70208 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581141.248673:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91907bb82000/0xf54e3944c2a70201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70208 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581141.248690:0:5874:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788581141.248693:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91906c6c6000 from 7 10000000:01000000:1.0:1788581141.248696:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788581141.248721:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581141.248729:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581141.248749:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581141.248770:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014246144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788581141.248807:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581141.249852:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f43587780 going to sleep for 11 seconds 00000100:00100000:3.0:1788581141.249889:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014246144 00000100:00100000:3.0:1788581141.249896:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014246144 00000100:00100000:3.0:1788581141.249937:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788581141.249947:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:5874:x1875463014246144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581141.249960:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581141.249975:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190413fe800/0xf54e3944c2a70216 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a7020f expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581141.249999:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190413fe800/0xf54e3944c2a70216 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a7020f expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581141.250008:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190413fe800/0xf54e3944c2a70216 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a7020f expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581141.250018:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413fe800, rc 0) 00000100:00100000:3.0:1788581141.250063:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014246144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581141.250069:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788581141.250186:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014246144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581141.250201:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70216 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581141.250210:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a70216 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581141.252696:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014246272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581141.252777:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581141.253042:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f43587780 going to sleep for 11 seconds 00000100:00100000:3.0:1788581141.253095:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014246272 00000100:00100000:3.0:1788581141.253114:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014246272 00000100:00100000:3.0:1788581141.253216:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788581141.253227:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014246272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581141.253951:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014246272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 722us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581141.253959:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788581141.254037:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014246272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581141.254085:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014246400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581141.254134:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581141.263318:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f43587780 going to sleep for 11 seconds 00000100:00100000:2.0:1788581141.263397:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014246400 00000100:00100000:2.0:1788581141.263415:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014246400 00000100:00100000:2.0:1788581141.263461:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788581141.263470:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014246400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581141.263894:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014246400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 424us (9759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581141.263902:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788581141.263966:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014246400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581141.264503:0:11736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:11736:1875463014246528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581141.264553:0:11736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581141.264780:0:11736:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907fc16000 going to sleep for 11 seconds 00000100:00100000:2.0:1788581141.264886:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014246528 00000100:00100000:2.0:1788581141.264891:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014246528 00000100:00100000:2.0:1788581141.264918:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788581141.264925:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:11736:x1875463014246528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581141.266685:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581141.266717:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995335296 00000100:00100000:1.0:1788581141.266724:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995335296 00000100:00100000:1.0:1788581141.266774:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 264 00000100:00100000:1.0:1788581141.266783:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+11:5613:x1875462995335296:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581141.266798:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581141.266816:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919044ca8a00/0xf54e3944c2a7021d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d900a expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581141.266847:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca8a00/0xf54e3944c2a7021d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d900a expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581141.266859:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919044ca8a00/0xf54e3944c2a7021d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d900a expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581141.266870:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8a00, rc 0) 00000100:00100000:1.0:1788581141.266934:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:5613:x1875462995335296:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 Request processed in 151us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581141.266942:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 264 00000100:00100000:2.0:1788581141.267012:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:11736:x1875463014246528:12345-0@lo:502:llog_process_th.0 Request processed in 2085us (2457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581141.267022:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788581141.267083:0:11736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:11736:1875463014246528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788581141.267117:0:11736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581141.267126:0:11736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581141.267128:0:11736:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788581141.267134:0:11736:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91906c6c6000 00000020:00000080:2.0:1788581141.267136:0:11736:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788581141.267226:0:11736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f4370b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:11736:1875463014246656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581141.267277:0:11736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788581141.267802:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788581141.269232:0:11736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788581141.270792:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014246656 00000100:00100000:3.0:1788581141.270805:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014246656 00000100:00100000:3.0:1788581141.270868:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788581141.270880:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:11736:x1875463014246656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581141.271164:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:11736:x1875463014246656:12345-0@lo:502:llog_process_th.0 Request processed in 286us (3886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581141.271174:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788581141.271205:0:11736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f4370b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:11736:1875463014246656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788581141.271281:0:11736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581141.271784:0:11736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581141.271788:0:11736:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788581141.271793:0:11736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788581141.271883:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788581141.271906:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788581141.271919:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70216 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581141.271931:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70216 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581141.271955:0:5874:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788581141.271959:0:5874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91904733b800 from 7 10000000:01000000:0.0:1788581141.271962:0:5874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581141.272016:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581141.272025:0:5874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581141.272039:0:5874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581141.272062:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014246784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581141.272107:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581141.272154:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907fc163c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581141.272170:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014246784 00000100:00100000:0.0:1788581141.272176:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014246784 00000100:00100000:0.0:1788581141.272213:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788581141.272220:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:5874:x1875463014246784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581141.272231:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581141.272269:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91907bc23200/0xf54e3944c2a7022b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a70224 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581141.272292:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91907bc23200/0xf54e3944c2a7022b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a70224 expref: 19 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581141.272303:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91907bc23200/0xf54e3944c2a7022b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a70224 expref: 19 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581141.272323:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc23200, rc 0) 00000100:00100000:0.0:1788581141.272359:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014246784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581141.272366:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788581141.272402:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014246784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581141.272416:0:5874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7022b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581141.272425:0:5874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a7022b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581141.272471:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014246912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581141.272497:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581141.272521:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907fc163c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581141.272535:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014246912 00000100:00100000:0.0:1788581141.272539:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014246912 00000100:00100000:0.0:1788581141.272554:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788581141.272559:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014246912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581141.272795:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014246912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581141.272803:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788581141.272831:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014246912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581141.272857:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014247040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581141.272890:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581141.272910:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907fc163c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581141.272920:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014247040 00000100:00100000:0.0:1788581141.272924:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014247040 00000100:00100000:0.0:1788581141.272939:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788581141.272945:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014247040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581141.273069:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:5874:x1875463014247040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581141.273077:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788581141.273110:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:5874:1875463014247040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581141.275175:0:11737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f4370b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:11737:1875463014247168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581141.275813:0:11737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581141.275825:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581141.275866:0:11737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c4780 going to sleep for 11 seconds 00000100:00100000:2.0:1788581141.275899:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014247168 00000100:00100000:1.0:1788581141.275905:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995335424 00000100:00100000:2.0:1788581141.275907:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014247168 00000100:00100000:1.0:1788581141.275912:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995335424 00000100:00100000:1.0:1788581141.275954:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 269 00000100:00100000:2.0:1788581141.275962:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788581141.275967:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:5613:x1875462995335424:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581141.275975:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:11737:x1875463014247168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581141.276271:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:5613:x1875462995335424:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 Request processed in 307us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581141.276290:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 269 00000100:00100000:2.0:1788581141.277326:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:11737:x1875463014247168:12345-0@lo:502:llog_process_th.0 Request processed in 1352us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581141.277335:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788581141.277837:0:11737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f4370b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:11737:1875463014247168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788581141.277872:0:11737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581141.277882:0:11737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581141.277884:0:11737:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788581141.277890:0:11737:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91904733b800 00000020:00000080:2.0:1788581141.277893:0:11737:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788581141.278795:0:11737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f4370b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:11737:1875463014247296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581141.278865:0:11737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581141.278914:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014247296 00000100:00100000:2.0:1788581141.278922:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014247296 00000100:00100000:2.0:1788581141.278961:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788581141.278970:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:11737:x1875463014247296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581141.279176:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:11737:x1875463014247296:12345-0@lo:502:llog_process_th.0 Request processed in 206us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581141.279184:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788581141.279235:0:11737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c4780 going to sleep for 11 seconds 00000100:00100000:2.0:1788581141.279272:0:11737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f4370b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:11737:1875463014247296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788581141.279297:0:11737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581141.279303:0:11737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581141.279305:0:11737:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788581141.279309:0:11737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788581141.279370:0:5874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788581141.279388:0:5874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788581141.279411:0:5874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7022b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581141.279421:0:5874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7022b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581141.288422:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581141.288463:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995335552 00000100:00100000:1.0:1788581141.288474:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995335552 00000100:00100000:1.0:1788581141.288525:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 272 00000100:00100000:1.0:1788581141.288537:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:5613:x1875462995335552:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581141.288773:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:5613:x1875462995335552:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 Request processed in 238us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581141.288782:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 272 00000100:00100000:3.0:1788581141.296587:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581141.296973:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995335680 00000100:00100000:0.0:1788581141.296985:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995335680 00000100:00100000:0.0:1788581141.297043:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 273 00000100:00100000:0.0:1788581141.297052:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:9974:x1875462995335680:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788581141.297304:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:9974:x1875462995335680:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 252us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581141.297311:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 273 00000100:00100000:1.0:1788581141.304351:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581141.304688:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995335808 00000100:00100000:3.0:1788581141.304699:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995335808 00000100:00100000:3.0:1788581141.304785:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 274 00000100:00100000:3.0:1788581141.304797:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:9974:x1875462995335808:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788581141.305061:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:9974:x1875462995335808:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 265us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581141.305070:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 274 00000100:00100000:0.0:1788581141.310213:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581141.310384:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995335936 00000100:00100000:3.0:1788581141.310395:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995335936 00000100:00100000:3.0:1788581141.310450:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 275 00000100:00100000:3.0:1788581141.310462:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:5613:x1875462995335936:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581141.310478:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581141.310496:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190413fec00/0xf54e3944c2a70232 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9011 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581141.310525:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190413fec00/0xf54e3944c2a70232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9011 expref: 13 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581141.310537:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190413fec00/0xf54e3944c2a70232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9011 expref: 13 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581141.310546:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413fec00, rc 0) 00000100:00100000:3.0:1788581141.310627:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:5613:x1875462995335936:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 Request processed in 167us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581141.310634:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 275 00000100:00100000:2.0:1788581141.316368:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581141.316562:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995336064 00000100:00100000:1.0:1788581141.316572:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995336064 00000100:00100000:1.0:1788581141.316653:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 276 00000100:00100000:1.0:1788581141.316663:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:5613:x1875462995336064:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581141.316943:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:5613:x1875462995336064:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 Request processed in 279us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581141.316952:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 276 00000100:00100000:1.0:1788581141.329683:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581141.329780:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995336192 00000100:00100000:3.0:1788581141.329790:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995336192 00000100:00100000:3.0:1788581141.329851:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 277 00000100:00100000:3.0:1788581141.329863:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:5613:x1875462995336192:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581141.332299:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:5613:x1875462995336192:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 Request processed in 2425us (2620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581141.332313:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 277 00000100:00100000:0.0:1788581141.338870:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581141.340420:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995336320 00000100:00100000:1.0:1788581141.340435:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995336320 00000100:00100000:0.0:1788581141.340541:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 278 00000100:00100000:0.0:1788581141.340554:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:9977:x1875462995336320:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788581141.340885:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:9977:x1875462995336320:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 333us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581141.340904:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 278 00000100:00100000:2.0:1788581141.351843:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581141.352055:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995336448 00000100:00100000:0.0:1788581141.352066:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995336448 00000100:00100000:0.0:1788581141.352129:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 279 00000100:00100000:0.0:1788581141.352140:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:9977:x1875462995336448:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788581141.352420:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:9977:x1875462995336448:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 281us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581141.352428:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 279 00010000:00010000:2.0:1788581141.552356:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581141.615795:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581141.615821:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014247424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581141.615898:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581141.616148:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014247424 00000100:00100000:1.0:1788581141.616156:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014247424 00000100:00100000:1.0:1788581141.616218:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788581141.616227:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014247424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581141.616278:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788581141.616519:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581141.616621:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014247424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 393us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581141.616628:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788581141.616715:0:3339:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788581141.616722:0:3339:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff919076884380, transno 4294967300 00000100:00100000:3.0:1788581141.616757:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014247424:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788581142.321620:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788581142.575939:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581143.599555:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581144.175578:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3341:1875463014247808:0@lo:400:kworker.0 00000100:00100000:0.0:1788581144.175653:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581144.175745:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788581144.175752:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014247680:0@lo:400:kworker.0 00000100:00100000:0.0:1788581144.175776:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581144.175798:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014248192:0@lo:400:kworker.0 00000100:00100000:0.0:1788581144.175825:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581144.175861:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014247808 00000100:00100000:0.0:1788581144.175869:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014247808 00000100:00100000:0.0:1788581144.175918:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014247680 00000100:00100000:0.0:1788581144.175922:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014247680 00000100:00100000:0.0:1788581144.175945:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788581144.175955:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3341:x1875463014247808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581144.176009:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3341:x1875463014247808:12345-0@lo:400:kworker.0 Request processed in 55us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581144.176033:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788581144.176052:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788581144.176059:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014247680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581144.176091:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014247680:12345-0@lo:400:kworker.0 Request processed in 32us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581144.176096:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788581144.176118:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014248192 00000100:00100000:0.0:1788581144.176122:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014248192 00000100:00100000:0.0:1788581144.176149:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788581144.176156:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014248192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581144.176189:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014248192:12345-0@lo:400:kworker.0 Request processed in 35us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581144.176195:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788581144.176213:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581144.176217:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581144.176296:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014247680:0@lo:400:kworker.0 00010000:00080000:0.0:1788581144.176312:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906ca97100 x1875463014248192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581144.176324:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014248192:0@lo:400:kworker.0 00000100:00100000:0.0:1788581144.176335:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3341:1875463014247808:0@lo:400:kworker.0 00000100:00100000:3.0:1788581144.176721:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014247552:0@lo:400:kworker.0 00000100:00100000:3.0:1788581144.176765:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581144.176794:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3339:1875463014248064:0@lo:400:kworker.0 00000100:00100000:3.0:1788581144.176816:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581144.176836:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581144.176842:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014247936:0@lo:400:kworker.0 00000100:00100000:3.0:1788581144.176863:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581144.176886:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014248064 00000100:00100000:3.0:1788581144.176890:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014248064 00000100:00100000:3.0:1788581144.176920:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788581144.176926:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3339:x1875463014248064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581144.176958:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3339:x1875463014248064:12345-0@lo:400:kworker.0 Request processed in 32us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581144.176973:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1788581144.176992:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581144.177010:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3339:1875463014248064:0@lo:400:kworker.0 00000100:00100000:2.0:1788581144.177220:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014247552 00000100:00100000:2.0:1788581144.177225:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014247552 00000100:00100000:2.0:1788581144.177291:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788581144.177299:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3339:x1875463014247552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581144.177360:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3339:x1875463014247552:12345-0@lo:400:kworker.0 Request processed in 61us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581144.177366:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788581144.177397:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014247552:0@lo:400:kworker.0 00000100:00100000:1.0:1788581144.177602:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014247936 00000100:00100000:1.0:1788581144.177607:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014247936 00000100:00100000:1.0:1788581144.177653:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788581144.177660:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014247936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581144.177713:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014247936:12345-0@lo:400:kworker.0 Request processed in 53us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581144.177719:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788581144.177749:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014247936:0@lo:400:kworker.0 00000100:00080000:2.0:1788581144.177935:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581144.454406:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581144.454455:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581144.454497:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581144.454530:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581144.454581:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995336704 00000100:00100000:0.0:1788581144.454592:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995336704 00000100:00100000:0.0:1788581144.454649:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995336960 00000100:00100000:0.0:1788581144.454652:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995336960 00000100:00100000:0.0:1788581144.454673:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 117 00000100:00100000:0.0:1788581144.454694:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995336704:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581144.454767:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995336704:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 86us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581144.454775:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 117 00000100:00100000:0.0:1788581144.454794:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 118 00000100:00100000:0.0:1788581144.454801:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995336960:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581144.454827:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995336960:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 27us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581144.454833:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 118 00000100:00100000:2.0:1788581144.454967:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995336576 00000100:00100000:2.0:1788581144.454972:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995336576 00000100:00100000:2.0:1788581144.455015:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 281 00000100:00100000:2.0:1788581144.455022:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995336576:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581144.455048:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995336576:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 28us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581144.455065:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 281 00000100:00080000:2.0:1788581144.455208:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581144.455591:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995336832 00000100:00100000:1.0:1788581144.455597:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995336832 00000100:00100000:1.0:1788581144.455655:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 65 00000100:00100000:1.0:1788581144.455663:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995336832:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581144.455721:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995336832:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 59us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581144.455728:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 65 00000100:00080000:2.0:1788581144.460351:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788581144.624915:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581144.694572:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581144.694599:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014248320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581144.694685:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581144.695017:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014248320 00000100:00100000:2.0:1788581144.695026:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014248320 00000100:00100000:2.0:1788581144.695085:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788581144.695096:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014248320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581144.695133:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581144.695192:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014248320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581144.695201:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1788581144.695340:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907b96e300 x1875463014248320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581144.695360:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014248320:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788581145.647721:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581146.671660:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581146.735654:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581146.735680:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014248448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581146.735754:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581146.735862:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014248448 00000100:00100000:0.0:1788581146.735872:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014248448 00000100:00100000:0.0:1788581146.735956:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788581146.735967:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014248448:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788581146.735989:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788581146.736004:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581146.736077:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014248448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581146.736102:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788581146.737407:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014248448:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788581147.699043:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581148.720075:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581149.298102:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014248704:0@lo:400:kworker.0 00000100:00100000:1.0:1788581149.298193:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581149.298316:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014248960:0@lo:400:kworker.0 00000100:00100000:1.0:1788581149.298357:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581149.298474:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014248704 00000100:00100000:0.0:1788581149.298483:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014248704 00000100:00100000:1.0:1788581149.298692:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788581149.298701:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f4370b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014248576:0@lo:400:kworker.0 00000100:00100000:1.0:1788581149.298741:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581149.298741:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788581149.298756:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014248704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581149.298770:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3338:1875463014249088:0@lo:400:kworker.0 00000100:00100000:1.0:1788581149.298797:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581149.298830:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014248960 00000100:00100000:1.0:1788581149.298834:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014248960 00000100:00100000:0.0:1788581149.298843:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014248704:12345-0@lo:400:kworker.0 Request processed in 90us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581149.298852:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788581149.298873:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014249088 00000100:00100000:0.0:1788581149.298877:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014249088 00000100:00100000:1.0:1788581149.298882:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788581149.298892:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014248960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581149.298907:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788581149.298916:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3338:x1875463014249088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581149.298938:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014248960:12345-0@lo:400:kworker.0 Request processed in 47us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581149.298947:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788581149.298960:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3338:x1875463014249088:12345-0@lo:400:kworker.0 Request processed in 44us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581149.298968:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1788581149.298973:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581149.298979:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581149.298998:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014248576 00000100:00100000:0.0:1788581149.299003:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014248576 00000100:00100000:1.0:1788581149.299011:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3338:1875463014249088:0@lo:400:kworker.0 00000100:00100000:1.0:1788581149.299024:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014248960:0@lo:400:kworker.0 00000100:00100000:0.0:1788581149.299202:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788581149.299209:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3338:x1875463014248576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581149.299273:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3338:x1875463014248576:12345-0@lo:400:kworker.0 Request processed in 64us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581149.299280:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788581149.299324:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014248704:0@lo:400:kworker.0 00000100:00100000:0.0:1788581149.299334:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014249216:0@lo:400:kworker.0 00000100:00100000:0.0:1788581149.299372:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581149.299400:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581149.299406:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014248832:0@lo:400:kworker.0 00000100:00100000:0.0:1788581149.299430:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581149.299467:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014248832 00000100:00100000:0.0:1788581149.299470:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014248832 00000100:00100000:0.0:1788581149.299495:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788581149.299501:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014248832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581149.299916:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014249216 00000100:00100000:1.0:1788581149.299921:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014249216 00000100:00100000:1.0:1788581149.299950:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788581149.299957:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014249216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581149.300004:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014249216:12345-0@lo:400:kworker.0 Request processed in 47us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581149.300020:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788581149.300307:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581149.300312:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788581149.300356:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c618a80 x1875463014249216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581149.300377:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014249216:0@lo:400:kworker.0 00000100:00100000:1.0:1788581149.300665:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f4370b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014248576:0@lo:400:kworker.0 00000100:00100000:0.0:1788581149.301665:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014248832:12345-0@lo:400:kworker.0 Request processed in 2159us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581149.301676:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788581149.306872:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014248832:0@lo:400:kworker.0 00000100:00100000:0.0:1788581149.574360:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581149.574402:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581149.574423:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581149.574467:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581149.574502:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995337216 00000100:00100000:0.0:1788581149.574512:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995337216 00000100:00100000:0.0:1788581149.574568:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995337472 00000100:00100000:0.0:1788581149.574572:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995337472 00000100:00100000:0.0:1788581149.574619:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 122 00000100:00100000:0.0:1788581149.574631:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995337216:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581149.574705:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995337216:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 77us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581149.574713:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 122 00000100:00100000:0.0:1788581149.574731:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 123 00000100:00100000:0.0:1788581149.574738:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f4370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995337472:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581149.574784:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f4370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995337472:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 46us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581149.574791:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 123 00000100:00100000:1.0:1788581149.574899:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995337344 00000100:00100000:1.0:1788581149.574905:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995337344 00000100:00100000:1.0:1788581149.574945:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 68 00000100:00100000:1.0:1788581149.574953:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995337344:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581149.574985:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995337344:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 34us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581149.574991:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 68 00000100:00100000:3.0:1788581149.575565:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995337088 00000100:00100000:3.0:1788581149.575571:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995337088 00000100:00100000:3.0:1788581149.575626:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 283 00000100:00100000:3.0:1788581149.575634:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995337088:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581149.575670:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995337088:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 37us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581149.575677:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 283 00000100:00080000:2.0:1788581149.577040:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788581149.577050:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788581149.750892:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581149.807707:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581149.818021:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014249344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581149.818103:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581149.818315:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014249344 00000100:00100000:2.0:1788581149.818327:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014249344 00000100:00100000:2.0:1788581149.818376:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788581149.818385:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014249344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581149.818420:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581149.818484:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014249344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581149.818492:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1788581149.819026:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907b96c000 x1875463014249344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581149.819048:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014249344:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788581150.767484:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581151.791423:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581151.855459:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581151.855574:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014249472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581151.855652:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581151.855945:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014249472 00000100:00100000:2.0:1788581151.855953:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014249472 00000100:00100000:2.0:1788581151.856109:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788581151.856119:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014249472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581151.856156:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581151.856211:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014249472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581151.856217:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788581151.856315:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014249472:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788581151.856592:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788581152.560804:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788581152.817328:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581153.839662:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581154.416633:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014249728:0@lo:400:kworker.0 00000100:00100000:0.0:1788581154.416719:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581154.416793:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014250240:0@lo:400:kworker.0 00000100:00100000:0.0:1788581154.416819:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581154.416848:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581154.416853:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014249856:0@lo:400:kworker.0 00000100:00100000:0.0:1788581154.416874:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581154.416912:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014249728 00000100:00100000:0.0:1788581154.416920:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014249728 00000100:00100000:0.0:1788581154.416958:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014249856 00000100:00100000:0.0:1788581154.416961:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014249856 00000100:00100000:0.0:1788581154.417008:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788581154.417016:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014249728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581154.417072:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014249728:12345-0@lo:400:kworker.0 Request processed in 56us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581154.417079:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788581154.417096:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788581154.417102:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014249856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581154.417133:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014249856:12345-0@lo:400:kworker.0 Request processed in 31us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581154.417139:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788581154.417178:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014249984:0@lo:400:kworker.0 00000100:00100000:0.0:1788581154.417205:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581154.417226:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788581154.417232:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014249600:0@lo:400:kworker.0 00000100:00100000:2.0:1788581154.417670:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014250240 00000100:00100000:2.0:1788581154.417677:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014250240 00000100:00100000:2.0:1788581154.417716:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014249984 00000100:00100000:2.0:1788581154.417719:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014249984 00000100:00100000:2.0:1788581154.417745:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788581154.417753:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014250240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581154.417808:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014250240:12345-0@lo:400:kworker.0 Request processed in 56us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581154.417816:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788581154.417831:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788581154.417836:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014249984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581154.417862:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014249984:12345-0@lo:400:kworker.0 Request processed in 26us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581154.417867:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788581154.417910:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788581154.417914:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581154.417917:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581154.417959:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014249856:0@lo:400:kworker.0 00000100:00100000:2.0:1788581154.417974:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014249728:0@lo:400:kworker.0 00010000:00080000:2.0:1788581154.417987:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c60f480 x1875463014250240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581154.417998:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014250240:0@lo:400:kworker.0 00000100:00100000:0.0:1788581154.419132:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581154.419471:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3338:1875463014250112:0@lo:400:kworker.0 00000100:00100000:0.0:1788581154.419507:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581154.419562:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014249984:0@lo:400:kworker.0 00000100:00100000:2.0:1788581154.420327:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014250112 00000100:00100000:2.0:1788581154.420339:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014250112 00000100:00100000:2.0:1788581154.420423:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788581154.420433:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3338:x1875463014250112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581154.420500:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3338:x1875463014250112:12345-0@lo:400:kworker.0 Request processed in 68us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581154.420507:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1788581154.420585:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581154.420620:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3338:1875463014250112:0@lo:400:kworker.0 00000100:00100000:1.0:1788581154.423838:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014249600 00000100:00100000:1.0:1788581154.423859:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014249600 00000100:00100000:1.0:1788581154.423949:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788581154.423960:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3338:x1875463014249600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581154.424329:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3338:x1875463014249600:12345-0@lo:400:kworker.0 Request processed in 370us (5199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581154.424338:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788581154.426015:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014249600:0@lo:400:kworker.0 00000100:00100000:3.0:1788581154.698230:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581154.698317:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581154.698443:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995337728 00000100:00100000:2.0:1788581154.698455:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995337728 00000100:00080000:0.0:1788581154.698636:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581154.702057:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 127 00000100:00100000:2.0:1788581154.702082:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2375:x1875462995337728:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581154.702179:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2375:x1875462995337728:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 109us (3961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581154.702186:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 127 00000100:00100000:2.0:1788581154.705486:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581154.705638:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995337856 00000100:00100000:3.0:1788581154.705649:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995337856 00000100:00100000:3.0:1788581154.705734:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:3.0:1788581154.705745:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2371:x1875462995337856:12345-192.168.201.13@tcp:9:kworker.0 00000020:00000080:3.0:1788581154.705790:0:6725:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a7016e 00000100:00080000:3.0:1788581154.705799:0:6725:0:(import.c:65:import_set_state_nolock()) ffff91907630f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788581154.705857:0:6725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788581154.706143:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+2:2371:x1875462995337856:12345-192.168.201.13@tcp:9:kworker.0 Request processed in 384us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581154.706150:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 19 00010000:00010000:3.0:1788581154.706175:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788581154.706578:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581154.707028:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995337600 00000100:00100000:1.0:1788581154.707036:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995337600 00000100:00100000:1.0:1788581154.707120:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 285 00000100:00100000:1.0:1788581154.707148:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2375:x1875462995337600:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581154.707208:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2375:x1875462995337600:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 79us (8890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581154.707216:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 285 00000100:00100000:3.0:1788581154.708267:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581154.709629:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995337984 00000100:00100000:2.0:1788581154.709643:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995337984 00000100:00100000:2.0:1788581154.709725:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 128 00000100:00100000:2.0:1788581154.709736:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2375:x1875462995337984:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581154.709824:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2375:x1875462995337984:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 90us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581154.709831:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 128 00000100:00080000:3.0:1788581154.710177:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788581154.863450:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581154.935447:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014250368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581154.935574:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581154.935831:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014250368 00000100:00100000:3.0:1788581154.935840:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014250368 00000100:00100000:3.0:1788581154.935956:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788581154.935968:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014250368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581154.938215:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788581154.938355:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014250368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2384us (2775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581154.938366:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1788581154.938533:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907b96f100 x1875463014250368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581154.938561:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014250368:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788581155.887807:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581156.911745:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581156.975675:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581156.975716:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014250496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581156.975819:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581156.975948:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014250496 00000100:00100000:1.0:1788581156.975962:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014250496 00000100:00100000:1.0:1788581156.976156:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788581156.976189:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014250496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581156.976228:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581156.976608:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014250496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 420us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581156.976617:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788581156.976719:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014250496:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788581156.984017:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788581157.938148:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581158.959523:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581159.535696:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014250624:0@lo:400:kworker.0 00000100:00100000:0.0:1788581159.535788:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581159.536135:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014250624 00000100:00100000:0.0:1788581159.536141:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581159.536143:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014250624 00000100:00100000:0.0:1788581159.536148:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014251008:0@lo:400:kworker.0 00000100:00100000:0.0:1788581159.536179:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581159.536187:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788581159.536196:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3339:x1875463014250624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581159.536208:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3341:1875463014250880:0@lo:400:kworker.0 00000100:00100000:0.0:1788581159.536233:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581159.536267:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3339:x1875463014250624:12345-0@lo:400:kworker.0 Request processed in 71us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581159.536268:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581159.536273:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014250752:0@lo:400:kworker.0 00000100:00100000:1.0:1788581159.536288:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788581159.536294:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581159.536328:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014251008 00000100:00100000:1.0:1788581159.536332:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014251008 00000100:00100000:2.0:1788581159.536625:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581159.536635:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3338:1875463014251136:0@lo:400:kworker.0 00000100:00100000:2.0:1788581159.536671:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014251264:0@lo:400:kworker.0 00000100:00100000:2.0:1788581159.536693:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581159.542326:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014250624:0@lo:400:kworker.0 00000100:00100000:0.0:1788581159.542349:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014251264 00000100:00100000:0.0:1788581159.542356:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014251264 00000100:00100000:1.0:1788581159.542365:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788581159.542375:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014251008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581159.542387:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788581159.542393:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014251264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581159.542634:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014250880 00000100:00100000:2.0:1788581159.542639:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014250880 00000100:00100000:3.0:1788581159.546189:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014250752 00000100:00100000:3.0:1788581159.546207:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014250752 00000100:00100000:2.0:1788581159.546571:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581159.546647:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014251264:12345-0@lo:400:kworker.0 Request processed in 4251us (9950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581159.546659:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1788581159.546728:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c61ad80 x1875463014251264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581159.546904:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014251264:0@lo:400:kworker.0 00000100:00100000:1.0:1788581159.546967:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014251008:12345-0@lo:400:kworker.0 Request processed in 4592us (10785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581159.546976:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788581159.547009:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014251008:0@lo:400:kworker.0 00000100:00100000:3.0:1788581159.548151:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014251136 00000100:00100000:3.0:1788581159.548166:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014251136 00000100:00100000:3.0:1788581159.548213:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788581159.548223:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014250752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581159.548309:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014250752:12345-0@lo:400:kworker.0 Request processed in 88us (12012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581159.548330:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788581159.548347:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788581159.548353:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3338:x1875463014251136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581159.548391:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3338:x1875463014251136:12345-0@lo:400:kworker.0 Request processed in 38us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581159.548397:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1788581159.548531:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581159.548537:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581159.548540:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581159.548569:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581159.548595:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788581159.548602:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3341:x1875463014250880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581159.548634:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3341:x1875463014250880:12345-0@lo:400:kworker.0 Request processed in 33us (12401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581159.548641:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788581159.548685:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3338:1875463014251136:0@lo:400:kworker.0 00000100:00100000:0.0:1788581159.549321:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014250752:0@lo:400:kworker.0 00000100:00100000:0.0:1788581159.549334:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3341:1875463014250880:0@lo:400:kworker.0 00000001:00100000:3.0:1788581159.602332:0:6750:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11f1870a-1d9b-4af2-bb25-e81f8742df75 00000020:00000080:3.0:1788581159.602340:0:6750:0:(genops.c:885:class_export_put()) final put ffff91907630b800/11f1870a-1d9b-4af2-bb25-e81f8742df75 00000020:00000080:0.0:1788581159.602418:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91907630b800/11f1870a-1d9b-4af2-bb25-e81f8742df75 for lustre-OST0000 00000020:00000080:0.0:1788581159.602494:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91907630f000 for lustre-OST0000 00000100:00100000:3.0:1788581159.813173:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581159.813221:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581159.813302:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581159.813461:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995338368 00000100:00100000:0.0:1788581159.813472:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995338368 00000100:00100000:2.0:1788581159.813483:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995338240 00000100:00100000:2.0:1788581159.813488:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995338240 00000100:00100000:1.0:1788581159.813543:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995338112 00000100:00100000:1.0:1788581159.813547:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995338112 00000100:00100000:1.0:1788581159.813591:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 287 00000100:00100000:1.0:1788581159.813601:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2372:x1875462995338112:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581159.813693:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2372:x1875462995338112:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 93us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581159.813700:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 287 00000100:00100000:0.0:1788581159.813825:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 132 00000100:00100000:0.0:1788581159.813833:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2372:x1875462995338368:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581159.813868:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2372:x1875462995338368:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 36us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581159.813874:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 132 00000100:00100000:2.0:1788581159.814854:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 133 00000100:00100000:2.0:1788581159.814865:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2372:x1875462995338240:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581159.814931:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2372:x1875462995338240:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 68us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581159.814939:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 133 00000100:00080000:3.0:1788581159.817215:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788581159.985173:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581160.047778:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014251392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581160.047861:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581160.048216:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014251392 00000100:00100000:3.0:1788581160.048224:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014251392 00000100:00100000:3.0:1788581160.048309:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788581160.048333:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014251392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581160.048367:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788581160.048431:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014251392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581160.048439:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1788581160.052331:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907b96d180 x1875463014251392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581160.052368:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014251392:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788581161.009725:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581162.032593:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581162.104835:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014251520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581162.104909:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581162.104987:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014251520 00000100:00100000:2.0:1788581162.104994:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014251520 00000100:00100000:2.0:1788581162.105047:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788581162.105057:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014251520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581162.105094:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581162.105141:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014251520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581162.105148:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788581162.105168:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581162.105201:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014251520:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788581162.800133:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788581163.056597:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581164.081904:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581164.668322:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014251648:0@lo:400:kworker.0 00000100:00100000:3.0:1788581164.668449:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581164.668528:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3339:1875463014252160:0@lo:400:kworker.0 00000100:00100000:3.0:1788581164.668609:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581164.668653:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581164.668660:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014252032:0@lo:400:kworker.0 00000100:00100000:3.0:1788581164.668693:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581164.668730:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014251776:0@lo:400:kworker.0 00000100:00100000:3.0:1788581164.668756:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581164.668784:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014252288:0@lo:400:kworker.0 00000100:00100000:3.0:1788581164.668815:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581164.668836:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581164.668842:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014251904:0@lo:400:kworker.0 00000100:00100000:3.0:1788581164.668863:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581164.668902:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014251648 00000100:00100000:3.0:1788581164.668911:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014251648 00000100:00100000:3.0:1788581164.668974:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788581164.668985:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3339:x1875463014251648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581164.669066:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3339:x1875463014251648:12345-0@lo:400:kworker.0 Request processed in 74us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.669074:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788581164.669129:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014252160 00000100:00100000:3.0:1788581164.669134:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014252160 00000100:00100000:3.0:1788581164.669190:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014251776 00000100:00100000:3.0:1788581164.669195:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014251776 00000100:00100000:3.0:1788581164.669207:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014251904 00000100:00100000:3.0:1788581164.669218:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014251904 00000100:00100000:3.0:1788581164.669234:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788581164.669240:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3339:x1875463014252160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581164.669306:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3339:x1875463014252160:12345-0@lo:400:kworker.0 Request processed in 66us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.669312:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788581164.669344:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788581164.669351:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014251776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581164.669404:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014251776:12345-0@lo:400:kworker.0 Request processed in 53us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.669410:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788581164.669424:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788581164.669429:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014251904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581164.669473:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014251904:12345-0@lo:400:kworker.0 Request processed in 43us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.669479:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788581164.669507:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014252032 00000100:00100000:3.0:1788581164.669511:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014252032 00000100:00100000:3.0:1788581164.669547:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014252288 00000100:00100000:3.0:1788581164.669564:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014252288 00000100:00100000:3.0:1788581164.669599:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788581164.669607:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014252032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581164.669647:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014252032:12345-0@lo:400:kworker.0 Request processed in 42us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.669653:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788581164.669672:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788581164.669677:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014252288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581164.669705:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014252288:12345-0@lo:400:kworker.0 Request processed in 29us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.669710:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788581164.669744:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581164.669749:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581164.669752:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581164.669816:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014251904:0@lo:400:kworker.0 00000100:00100000:3.0:1788581164.669830:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014251776:0@lo:400:kworker.0 00010000:00080000:3.0:1788581164.669843:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907b96f100 x1875463014252288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581164.669853:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014252288:0@lo:400:kworker.0 00000100:00100000:3.0:1788581164.669893:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014252032:0@lo:400:kworker.0 00000100:00100000:3.0:1788581164.669902:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014251648:0@lo:400:kworker.0 00000100:00100000:3.0:1788581164.669921:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3339:1875463014252160:0@lo:400:kworker.0 00000100:00100000:3.0:1788581164.933154:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581164.933208:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581164.933290:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581164.933328:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995338752 00000100:00100000:3.0:1788581164.933357:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995338752 00000100:00100000:3.0:1788581164.933438:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995338624 00000100:00100000:3.0:1788581164.933441:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995338624 00000100:00100000:3.0:1788581164.933465:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 137 00000100:00100000:3.0:1788581164.933476:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2373:x1875462995338752:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581164.933581:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2373:x1875462995338752:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 106us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.933591:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 137 00000100:00100000:3.0:1788581164.933740:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 138 00000100:00100000:3.0:1788581164.933760:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2373:x1875462995338624:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581164.933796:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2373:x1875462995338624:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 39us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581164.933804:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 138 00000100:00080000:3.0:1788581164.933828:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581164.944121:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995338496 00000100:00100000:0.0:1788581164.944143:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995338496 00000100:00100000:0.0:1788581164.944276:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 289 00000100:00100000:0.0:1788581164.944290:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2373:x1875462995338496:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581164.944407:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2373:x1875462995338496:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 119us (11267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581164.944424:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 289 00000001:02000400:3.0:1788581165.104514:0:11902:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 00:06:02 (1788581162) 00010000:00010000:0.0:1788581165.106756:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581165.183368:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581165.183403:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014252416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581165.183512:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581165.183610:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014252416 00000100:00100000:1.0:1788581165.183632:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014252416 00000100:00100000:1.0:1788581165.183699:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788581165.183711:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014252416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581165.184882:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581165.185011:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014252416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1298us (1495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581165.185022:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1788581165.185096:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919075e92680 x1875463014252416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581165.185126:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014252416:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788581166.127473:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581167.151534:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581167.215915:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581167.215955:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014252544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581167.216070:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581167.217228:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014252544 00000100:00100000:1.0:1788581167.217302:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014252544 00000100:00100000:1.0:1788581167.217437:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788581167.217452:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014252544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581167.217512:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788581167.217828:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581167.217898:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014252544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 450us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581167.217907:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788581167.218057:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014252544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581167.364904:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581167.365147:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995338880 00000100:00100000:0.0:1788581167.365161:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995338880 00000100:00100000:0.0:1788581167.365371:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 32 00000100:00100000:0.0:1788581167.365448:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:10248:x1875462995338880:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581167.365479:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581167.365512:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70239 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9018 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.365600:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23400/0xf54e3944c2a70240 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.365618:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23400/0xf54e3944c2a70240 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.365635:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23400/0xf54e3944c2a70240 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581167.365683:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788581167.365687:0:9658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788581167.365734:0:9658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23400/0xf54e3944c2a70240 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.365765:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70239 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9018 expref: 7 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.365809:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23400/0xf54e3944c2a70240 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9018 expref: 6 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.365820:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91904995ad00) 00010000:00010000:0.0:1788581167.365823:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581167.365828:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc23400, rc 0) 00000100:00080000:2.0:1788581167.366038:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581167.366087:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:10248:x1875462995338880:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 704us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581167.366106:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 32 00000100:00100000:0.0:1788581167.391965:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581167.392229:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995339008 00000100:00100000:3.0:1788581167.392361:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995339008 00000100:00100000:3.0:1788581167.392519:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:3.0:1788581167.392533:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:10249:x1875462995339008:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581167.392562:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581167.392592:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70247 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d901f expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.392703:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a7024e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.392723:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a7024e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.392738:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a7024e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.392757:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70255 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.392765:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70255 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.392772:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70255 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393517:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7025c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393535:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7025c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393544:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7025c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581167.393581:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788581167.393585:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581167.393614:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7025c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393638:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a7024e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393644:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a7024e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393652:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a7024e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393659:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413ff000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581167.393664:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a7024e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393673:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a7024e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393688:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91904995ad00) 00010000:00010000:3.0:1788581167.393691:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581167.393696:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a7024e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393702:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a7024e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393719:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70255 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393725:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70255 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393730:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70255 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393742:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413ffc00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581167.393745:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70255 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393751:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70255 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393759:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff919052341a00) 00010000:00010000:3.0:1788581167.393761:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581167.393764:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70255 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393770:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70255 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393813:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70247 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d901f expref: 8 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393829:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7025c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d901f expref: 7 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581167.393837:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff919052341700) 00010000:00010000:3.0:1788581167.393839:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581167.393842:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413fe200, rc 0) 00000100:00100000:3.0:1788581167.394567:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:10249:x1875462995339008:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 2031us (2613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581167.394579:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:1.0:1788581167.415858:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581167.416096:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995339264 00000100:00100000:0.0:1788581167.416112:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995339264 00000100:00100000:0.0:1788581167.416205:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00100000:0.0:1788581167.416220:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:10249:x1875462995339264:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581167.416426:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581167.416459:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70263 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9026 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.416588:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7026a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.416607:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7026a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.416623:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7026a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.418978:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70271 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.419005:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70271 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.419093:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70271 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.419506:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22000/0xf54e3944c2a70278 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.419518:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22000/0xf54e3944c2a70278 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.419526:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22000/0xf54e3944c2a70278 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581167.419537:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788581167.420005:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7026a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.420015:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7026a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.420096:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7026a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.420102:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23a00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581167.420106:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7026a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.420124:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7026a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.420137:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff919052341700) 00010000:00010000:0.0:1788581167.420140:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581167.420145:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7026a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.420150:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7026a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.420163:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70271 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.420169:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70271 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.420174:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70271 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.420179:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581167.420181:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70271 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.420187:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70271 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.420193:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91904995a400) 00010000:00010000:0.0:1788581167.420195:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581167.420198:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70271 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.420213:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70271 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.421001:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70263 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9026 expref: 10 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.421181:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22000/0xf54e3944c2a70278 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9026 expref: 9 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581167.421191:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91904995af00) 00010000:00010000:0.0:1788581167.421194:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581167.421197:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22000, rc 0) 00000100:00100000:0.0:1788581167.421343:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:10249:x1875462995339264:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 5125us (5502us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788581167.421352:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00100000:2.0:1788581167.433026:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581167.433129:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995339392 00000100:00100000:3.0:1788581167.433163:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995339392 00000100:00100000:3.0:1788581167.433271:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 35 00000100:00100000:3.0:1788581167.433284:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:10249:x1875462995339392:12345-192.168.201.13@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788581167.434839:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:10249:x1875462995339392:12345-192.168.201.13@tcp:59:lhsmtool_posix.0 Request processed in 1544us (1817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581167.434856:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 35 00000040:00080000:2.0:1788581167.920143:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788581168.180239:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581169.200841:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788581169.376552:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:2.0:1788581169.777567:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014253056:0@lo:400:kworker.0 00000100:00100000:2.0:1788581169.777645:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581169.777724:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788581169.777732:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014252672:0@lo:400:kworker.0 00000100:00100000:2.0:1788581169.777776:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581169.777802:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3338:1875463014253184:0@lo:400:kworker.0 00000100:00100000:2.0:1788581169.777829:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581169.777857:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014252800:0@lo:400:kworker.0 00000100:00100000:2.0:1788581169.777879:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581169.777897:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014253312:0@lo:400:kworker.0 00000100:00100000:2.0:1788581169.777917:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581169.777935:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581169.777941:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014252928:0@lo:400:kworker.0 00000100:00100000:2.0:1788581169.777977:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581169.778014:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014253056 00000100:00100000:2.0:1788581169.778022:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014253056 00000100:00100000:2.0:1788581169.778077:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014253312 00000100:00100000:2.0:1788581169.778080:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014253312 00000100:00100000:2.0:1788581169.778105:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788581169.778115:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014253056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581169.778178:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014253056:12345-0@lo:400:kworker.0 Request processed in 55us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581169.778186:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788581169.778214:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788581169.778222:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014253312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581169.778510:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014253312:12345-0@lo:400:kworker.0 Request processed in 289us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581169.778518:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788581169.778541:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014252672 00000100:00100000:2.0:1788581169.778545:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014252672 00000100:00100000:2.0:1788581169.778583:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788581169.778590:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3338:x1875463014252672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581169.778623:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3338:x1875463014252672:12345-0@lo:400:kworker.0 Request processed in 34us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581169.778629:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788581169.778785:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014253184 00000100:00100000:2.0:1788581169.778790:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014253184 00000100:00100000:2.0:1788581169.779369:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014252800 00000100:00100000:2.0:1788581169.779375:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014252800 00000100:00100000:3.0:1788581169.781823:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014252928 00000100:00100000:3.0:1788581169.781839:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014252928 00000100:00100000:3.0:1788581169.781889:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788581169.781900:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3338:x1875463014253184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581169.781995:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3338:x1875463014253184:12345-0@lo:400:kworker.0 Request processed in 97us (4164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581169.782001:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788581169.782019:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788581169.782026:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014252800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581169.782054:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014252800:12345-0@lo:400:kworker.0 Request processed in 29us (4175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581169.782059:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788581169.782070:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788581169.782075:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014252928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581169.782100:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014252928:12345-0@lo:400:kworker.0 Request processed in 26us (4124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581169.782105:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1788581169.782800:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581169.782814:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581169.782818:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581169.784199:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014252928:0@lo:400:kworker.0 00000100:00100000:2.0:1788581169.784228:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014252800:0@lo:400:kworker.0 00010000:00080000:2.0:1788581169.784460:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c61b800 x1875463014253312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581169.784473:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014253312:0@lo:400:kworker.0 00000100:00100000:2.0:1788581169.784516:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3338:1875463014252672:0@lo:400:kworker.0 00000100:00100000:2.0:1788581169.784529:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3338:1875463014253184:0@lo:400:kworker.0 00000100:00100000:2.0:1788581169.784541:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014253056:0@lo:400:kworker.0 00000100:00100000:3.0:1788581170.061325:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581170.061360:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581170.061391:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581170.061431:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995339776 00000100:00100000:3.0:1788581170.061441:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995339776 00000100:00100000:3.0:1788581170.061502:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995339648 00000100:00100000:3.0:1788581170.061507:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995339648 00000100:00100000:3.0:1788581170.061534:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 142 00000100:00100000:3.0:1788581170.061545:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2375:x1875462995339776:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581170.061618:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2375:x1875462995339776:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 75us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581170.061627:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 142 00000100:00100000:3.0:1788581170.061645:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 143 00000100:00100000:3.0:1788581170.061651:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2375:x1875462995339648:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581170.061677:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2375:x1875462995339648:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 26us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581170.061683:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 143 00000100:00080000:3.0:1788581170.061700:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581170.061892:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995339520 00000100:00100000:1.0:1788581170.061898:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995339520 00000100:00100000:1.0:1788581170.061936:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 291 00000100:00100000:1.0:1788581170.061944:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2375:x1875462995339520:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581170.061987:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2375:x1875462995339520:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 43us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581170.061994:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 291 00000100:00100000:0.0:1788581170.084148:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581170.084216:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995339904 00000100:00100000:1.0:1788581170.084228:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995339904 00000100:00100000:1.0:1788581170.084368:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00100000:1.0:1788581170.084379:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:10292:x1875462995339904:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1788581170.084401:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581170.084424:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70286 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d902d expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084514:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7028d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084530:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7028d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084544:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7028d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084561:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70294 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084568:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084594:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084800:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7028d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084808:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7028d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084815:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7028d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084821:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581170.084826:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7028d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084831:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7028d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084842:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91904995ad00) 00010000:00010000:1.0:1788581170.084843:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581170.084846:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7028d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084851:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7028d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084858:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084862:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70294 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084870:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70294 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084873:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581170.084875:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70294 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084878:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70294 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084882:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91905c6f1b00) 00010000:00010000:1.0:1788581170.084884:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581170.084885:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70294 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084888:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70294 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084914:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70286 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d902d expref: 9 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084921:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91904995ad00) 00010000:00010000:1.0:1788581170.084922:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581170.084924:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70286 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d902d expref: 9 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.084930:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8400, rc 0) 00000100:00100000:1.0:1788581170.084991:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:10292:x1875462995339904:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 614us (854us total) trans 0 rc 301/301 00000100:00100000:1.0:1788581170.085019:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00100000:3.0:1788581170.092214:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581170.092425:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995340160 00000100:00100000:2.0:1788581170.092447:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995340160 00000100:00100000:2.0:1788581170.092505:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:2.0:1788581170.092517:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:10292:x1875462995340160:12345-192.168.201.13@tcp:36:lfs.0 00010000:00010000:2.0:1788581170.092582:0:5878:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581170.092613:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23400/0xf54e3944c2a70240 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9018 expref: 8 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.092642:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91904995ad00) 00010000:00010000:2.0:1788581170.092818:0:5878:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581170.093040:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7029b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.093055:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7029b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.093065:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7029b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.093078:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a702a2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.093085:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a702a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.093091:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a702a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581170.094524:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788581170.094540:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7029b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.094550:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7029b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.094557:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7029b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.094569:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb82a00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581170.094573:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7029b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.094581:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7029b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.094595:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525b00) 00010000:00010000:3.0:1788581170.094598:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581170.094602:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7029b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.094608:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7029b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581170.094623:0:5878:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e216c19 reply state 00000000f6ce6e3b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a702a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581170.094631:0:5878:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788581170.094743:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:10292:x1875462995340160:12345-192.168.201.13@tcp:36:lfs.0 Request processed in 2225us (2533us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788581170.094751:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 37 00010000:00010000:0.0:1788581170.098102:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a702a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.098119:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a702a2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.098128:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a702a2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.098134:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581170.098138:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a702a2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.098161:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a702a2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.098179:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91905c525700) 00010000:00010000:0.0:1788581170.098182:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581170.098187:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a702a2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.098194:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a702a2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581170.223971:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581170.224024:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995340288 00000100:00100000:2.0:1788581170.224035:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995340288 00000100:00100000:2.0:1788581170.224135:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 38 00000100:00100000:2.0:1788581170.224156:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:10300:x1875462995340288:12345-192.168.201.13@tcp:101:lctl.0 00010000:00010000:2.0:1788581170.224183:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581170.224209:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a702a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9034 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.224359:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a702b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.224386:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a702b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.224398:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a702b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581170.224437:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788581170.224441:0:5876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788581170.224480:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a702b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.224503:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a702a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9034 expref: 10 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.224520:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a702b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9034 expref: 9 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.224528:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525000) 00010000:00010000:2.0:1788581170.224531:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788581170.224534:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb83a00, rc 0) 00000100:00100000:2.0:1788581170.224607:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:10300:x1875462995340288:12345-192.168.201.13@tcp:101:lctl.0 Request processed in 453us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581170.224615:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 38 00010000:00010000:0.0:1788581170.224687:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581170.286783:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581170.286885:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995340416 00000100:00100000:0.0:1788581170.286895:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995340416 00000100:00100000:0.0:1788581170.286980:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 39 00000100:00100000:0.0:1788581170.286989:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:10306:x1875462995340416:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:0.0:1788581170.287008:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581170.287026:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a702b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d903b expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287078:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a702be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287089:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a702be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287097:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a702be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287107:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a702c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287123:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a702c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287128:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a702c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287234:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23400/0xf54e3944c2a702cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287286:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23400/0xf54e3944c2a702cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287295:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23400/0xf54e3944c2a702cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581170.287322:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788581170.287326:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788581170.287371:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23400/0xf54e3944c2a702cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287383:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a702be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287390:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a702be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287407:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a702be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287412:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581170.287417:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a702be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287443:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a702be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287456:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525000) 00010000:00010000:0.0:1788581170.287459:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581170.287463:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a702be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287470:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a702be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287484:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a702c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287490:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a702c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287495:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a702c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287500:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581170.287502:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a702c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287508:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a702c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287515:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91904995aa00) 00010000:00010000:0.0:1788581170.287517:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581170.287519:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a702c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287534:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a702c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287564:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a702b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d903b expref: 11 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287576:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23400/0xf54e3944c2a702cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d903b expref: 10 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.287583:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:0.0:1788581170.287586:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788581170.287588:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc23400, rc 0) 00000100:00100000:0.0:1788581170.287657:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+10:10306:x1875462995340416:12345-192.168.201.13@tcp:101:bash.0 Request processed in 668us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581170.287664:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 39 00000100:00100000:2.0:1788581170.289137:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014253440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581170.289216:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581170.289313:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014253440 00000100:00100000:3.0:1788581170.289320:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014253440 00000100:00100000:3.0:1788581170.289363:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788581170.289373:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014253440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581170.289420:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788581170.290932:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014253440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1554us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581170.290943:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1788581170.290952:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919075e93100 x1875463014253440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581170.291033:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014253440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581170.291518:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581170.291566:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995340672 00000100:00100000:1.0:1788581170.291581:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995340672 00000100:00100000:1.0:1788581170.291619:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 40 00000100:00100000:1.0:1788581170.291625:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+10:10306:x1875462995340672:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:1.0:1788581170.291640:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581170.291657:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a702d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9042 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.291770:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a702da lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.291781:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a702da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.291789:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a702da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.291847:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a702e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.291852:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a702e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.291856:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a702e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788581170.292716:0:9658:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788581170.292857:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a702e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.293052:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a702e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.293059:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a702e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.293089:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a702da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.293093:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a702da lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.293098:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a702da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.293102:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581170.293105:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a702da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.293109:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a702da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.293118:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:1.0:1788581170.293120:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581170.293123:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a702da lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.293127:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a702da lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788581170.293135:0:9658:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d65602a reply state 000000000f0d7319 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a702e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581170.293306:0:9658:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788581170.293342:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a702d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9042 expref: 13 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.293356:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a702e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9042 expref: 12 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.293364:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905c6f1c00) 00010000:00010000:1.0:1788581170.293366:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581170.293369:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9000, rc 0) 00000100:00100000:1.0:1788581170.293449:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:10306:x1875462995340672:12345-192.168.201.13@tcp:101:bash.0 Request processed in 1823us (1932us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788581170.293458:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 40 00010000:00010000:0.0:1788581170.296850:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a702e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.296880:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a702e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.296892:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a702e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.296898:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581170.296903:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a702e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.296938:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a702e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.296958:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91905c6f1b00) 00010000:00010000:0.0:1788581170.296961:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581170.296968:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a702e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.296983:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a702e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581170.298000:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581170.298090:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995340800 00000100:00100000:2.0:1788581170.298100:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995340800 00000100:00100000:2.0:1788581170.298152:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:2.0:1788581170.298161:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2371:x1875462995340800:12345-192.168.201.13@tcp:8:bash.0 00010000:00080000:2.0:1788581170.298192:0:10329:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:2.0:1788581170.298229:0:10329:0:(genops.c:1385:class_connect()) connect: client 11f1870a-1d9b-4af2-bb25-e81f8742df75, cookie 0xf54e3944c2a702f6 00002000:00100000:2.0:1788581170.298282:0:10329:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 11f1870a-1d9b-4af2-bb25-e81f8742df75/ffff919076114800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788581170.298294:0:10329:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788581170.298504:0:10329:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788581170.298527:0:10329:0:(import.c:65:import_set_state_nolock()) ffff919076111800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581170.298595:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2371:x1875462995340800:12345-192.168.201.13@tcp:8:bash.0 Request processed in 433us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581170.299646:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:2.0:1788581170.301122:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581170.301231:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995340928 00000100:00100000:3.0:1788581170.301360:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995340928 00000100:00080000:0.0:1788581170.301463:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581170.301559:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:3.0:1788581170.301572:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:0:x1875462995340928:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1788581170.301591:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581170.301617:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004190064c/0xf54e3944c2a702fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9049 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581170.301644:0:6725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581170.301670:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=386s v=(0 0) 00010000:00010000:3.0:1788581170.301675:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581170.301685:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004190064c/0xf54e3944c2a702fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9049 expref: 7 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.301705:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004190064c/0xf54e3944c2a702fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9049 expref: 7 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.301719:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413ffc00, rc 0) 00000100:00100000:3.0:1788581170.301774:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:0:x1875462995340928:12345-192.168.201.13@tcp:101:bash.0 Request processed in 206us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581170.301781:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:3.0:1788581170.315755:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581170.316034:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995341056 00000100:00100000:0.0:1788581170.316045:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995341056 00000100:00100000:0.0:1788581170.316116:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:0.0:1788581170.316127:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:10306:x1875462995341056:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:0.0:1788581170.316145:0:6722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581170.316166:0:6722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd8d3873/0xf54e3944c2a70304 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9050 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.316202:0:6722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004190064c/0xf54e3944c2a702fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9049 expref: 8 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.316212:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581170.316216:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581170.316222:0:6722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd8d3873/0xf54e3944c2a70304 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9050 expref: 8 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.316331:0:6722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004190064c/0xf54e3944c2a702fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9049 expref: 8 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.316346:0:6722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004190064c/0xf54e3944c2a702fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9049 expref: 8 pid: 6725 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581170.316362:0:6722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6722:1875463014253568:192.168.201.13@tcp:104: 00000100:00100000:0.0:1788581170.316573:0:6722:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788581170.319913:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581170.320029:0:6722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6722:1875463014253568:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581170.320082:0:6722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd8d3873/0xf54e3944c2a70304 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9050 expref: 8 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.320103:0:6722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc23600, rc 0) 00000100:00100000:3.0:1788581170.320165:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:10306:x1875462995341056:12345-192.168.201.13@tcp:101:bash.0 Request processed in 4040us (4418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581170.320174:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:1.0:1788581170.320803:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995341184 00000100:00100000:1.0:1788581170.320812:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995341184 00010000:00010000:1.0:1788581170.320855:0:5862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004190064c/0xf54e3944c2a702fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9049 expref: 8 pid: 6725 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581170.320896:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 35 00000100:00100000:1.0:1788581170.320906:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2374:x1875462995341184:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581170.320922:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581170.320947:0:5862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004190064c/0xf54e3944c2a702fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9049 expref: 8 pid: 6725 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.320961:0:5862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004190064c/0xf54e3944c2a702fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9049 expref: 8 pid: 6725 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.320999:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004190064c/0xf54e3944c2a702fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9049 expref: 8 pid: 6725 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.321021:0:5862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581170.321026:0:5862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581170.321034:0:5862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd8d3873/0xf54e3944c2a70304 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9050 expref: 7 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.321044:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd8d3873/0xf54e3944c2a70304 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9050 expref: 7 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.321082:0:5862:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bd8d3873/0xf54e3944c2a70304 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9050 expref: 7 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581170.321096:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075e90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5862:1875463014253696:192.168.201.13@tcp:105: 00000100:00100000:1.0:1788581170.321186:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048dc96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581170.326715:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075e90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5862:1875463014253696:192.168.201.13@tcp:105: 00010000:00010000:1.0:1788581170.326745:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581170.326812:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2374:x1875462995341184:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 5907us (6906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581170.326822:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 35 00000100:00100000:2.0:1788581170.328788:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581170.328922:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995341440 00000100:00100000:0.0:1788581170.328933:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995341440 00000100:00100000:0.0:1788581170.328994:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:0.0:1788581170.329005:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+12:10306:x1875462995341440:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:0.0:1788581170.329424:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:10306:x1875462995341440:12345-192.168.201.13@tcp:35:bash.0 Request processed in 419us (642us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788581170.329434:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:2.0:1788581170.445964:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581170.446107:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995341696 00000100:00100000:3.0:1788581170.446119:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995341696 00000100:00100000:3.0:1788581170.446202:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:3.0:1788581170.446214:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:10316:x1875462995341696:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581170.446313:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581170.446335:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7030b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9057 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581170.446447:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788581170.446570:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7030b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9057 expref: 15 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.446771:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525000) 00010000:00010000:3.0:1788581170.446774:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581170.446780:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7030b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9057 expref: 15 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.446796:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413ff200, rc 0) 00000100:00100000:3.0:1788581170.446860:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+14:10316:x1875462995341696:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 648us (908us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1788581170.446885:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:1.0:1788581170.450075:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581170.450178:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995341952 00000100:00100000:0.0:1788581170.450188:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995341952 00000100:00100000:0.0:1788581170.450331:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:0.0:1788581170.450343:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+14:10316:x1875462995341952:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:0.0:1788581170.450626:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+15:10316:x1875462995341952:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 284us (558us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788581170.450635:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:3.0:1788581170.519784:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581170.519881:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995342080 00000100:00100000:2.0:1788581170.519890:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995342080 00000100:00100000:2.0:1788581170.519978:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:2.0:1788581170.519986:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+15:10322:x1875462995342080:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1788581170.520007:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581170.520024:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70319 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d905e expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.520095:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70320 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.520106:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.520115:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581170.520159:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788581170.520162:0:5876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788581170.520177:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.520197:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70319 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d905e expref: 17 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.520210:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d905e expref: 16 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.520215:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:2.0:1788581170.520217:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788581170.520220:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb83200, rc 0) 00000100:00100000:2.0:1788581170.520342:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+16:10322:x1875462995342080:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 357us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581170.520347:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:3.0:1788581170.525079:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581170.532363:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995342336 00000100:00100000:1.0:1788581170.532382:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995342336 00000100:00100000:0.0:1788581170.534006:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 43 00000100:00100000:0.0:1788581170.534031:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+16:10322:x1875462995342336:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1788581170.534052:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581170.534072:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70327 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9065 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.534328:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a7032e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.534342:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a7032e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.534354:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a7032e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581170.534367:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788581170.534568:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70327 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9065 expref: 19 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.534588:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a7032e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9065 expref: 18 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.534597:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905c6f1c00) 00010000:00010000:0.0:1788581170.534600:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581170.534603:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc23e00, rc 0) 00000100:00100000:0.0:1788581170.534760:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:10322:x1875462995342336:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 740us (9689us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788581170.534768:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 43 00000100:00100000:3.0:1788581170.549718:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581170.549765:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581170.549813:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995342592 00000100:00100000:3.0:1788581170.549823:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995342592 00000100:00100000:3.0:1788581170.549897:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:3.0:1788581170.549908:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:2374:x1875462995342592:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581170.549923:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581170.549949:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a7032e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9065 expref: 18 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.549968:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905c6f1c00) 00010000:00010000:3.0:1788581170.549973:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581170.550017:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+17:2374:x1875462995342592:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 112us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581170.550024:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:3.0:1788581170.550229:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995342720 00000100:00100000:3.0:1788581170.550260:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995342720 00000100:00100000:3.0:1788581170.550292:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:3.0:1788581170.550299:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+17:10322:x1875462995342720:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581170.550320:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581170.550377:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7033c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d906c expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.550682:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70343 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.550695:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70343 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.550706:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70343 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581170.550718:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788581170.550836:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7033c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d906c expref: 20 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.550852:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70343 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d906c expref: 19 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.550872:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905c6f1c00) 00010000:00010000:3.0:1788581170.550875:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788581170.550877:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413ffc00, rc 0) 00000100:00100000:3.0:1788581170.550919:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:10322:x1875462995342720:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 619us (1153us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788581170.550925:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:3.0:1788581170.565836:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581170.565968:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995342848 00000100:00100000:2.0:1788581170.565979:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995342848 00000100:00100000:2.0:1788581170.566050:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00100000:2.0:1788581170.566060:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2372:x1875462995342848:12345-192.168.201.13@tcp:1:lfs.0 00010000:00010000:2.0:1788581170.566109:0:6723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a70351 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.566128:0:6723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd8d3873/0xf54e3944c2a70304 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9050 expref: 7 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.566135:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581170.566140:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581170.566145:0:6723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a70351 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.566186:0:6723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd8d3873/0xf54e3944c2a70304 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9050 expref: 7 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.566202:0:6723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd8d3873/0xf54e3944c2a70304 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9050 expref: 7 pid: 6722 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581170.566216:0:6723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f8b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6723:1875463014253824:192.168.201.13@tcp:104: 00000100:00100000:2.0:1788581170.566366:0:6723:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c915300 going to sleep for 11 seconds 00000100:00100000:2.0:1788581170.575343:0:6723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f8b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6723:1875463014253824:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581170.575373:0:6723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a70351 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581170.575874:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581170.576371:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995342976 00000100:00100000:1.0:1788581170.576380:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995342976 00002000:00100000:1.0:1788581170.576425:0:6728:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff91907b96ed80 x1875462995342976/t0(0) o4->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:526/0 lens 504/0 e 0 to 0 dl 1788581181 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788581170.576436:0:6728:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91907b96ed80 with x1875462995342976 ext(0->12) 00010000:00010000:1.0:1788581170.576443:0:6728:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bd8d3873/0xf54e3944c2a70304 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9050 expref: 8 pid: 6722 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.576457:0:6728:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bd8d3873/0xf54e3944c2a70304 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9050 expref: 8 pid: 6722 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788581170.576465:0:6728:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91907b96ed80 00000100:00100000:1.0:1788581170.576499:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:1.0:1788581170.576510:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2375:x1875462995342976:12345-192.168.201.13@tcp:4:lfs.0 00000001:00100000:0.0:1788581170.618915:0:7696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11f1870a-1d9b-4af2-bb25-e81f8742df75 00000001:00080000:0.0:1788581170.655006:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1788581170.655207:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2375:x1875462995342976:12345-192.168.201.13@tcp:4:lfs.0 Request processed in 78691us (79327us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788581170.655222:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00002000:00100000:1.0:1788581170.655279:0:6728:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff91907b96ed80 x1875462995342976/t4294967299(0) o4->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:526/0 lens 504/448 e 0 to 0 dl 1788581181 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788581170.655290:0:6728:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91907b96ed80 with x1875462995342976 ext(0->12) 00010000:00010000:1.0:1788581170.655302:0:6728:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bd8d3873/0xf54e3944c2a70304 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9050 expref: 7 pid: 6722 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581170.655319:0:6728:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bd8d3873/0xf54e3944c2a70304 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9050 expref: 7 pid: 6722 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788581170.655343:0:6728:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91907b96ed80 00000100:00100000:3.0:1788581170.658782:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581170.658914:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995343104 00000100:00100000:0.0:1788581170.658925:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995343104 00010000:00010000:0.0:1788581170.658969:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd8d3873/0xf54e3944c2a70304 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9050 expref: 7 pid: 6722 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581170.659007:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00100000:0.0:1788581170.659018:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2374:x1875462995343104:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581170.659055:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788581170.659077:0:6739:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788581170.659080:0:6739:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788581169 00002000:00010000:0.0:1788581170.659082:0:6739:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788581170 00002000:00010000:0.0:1788581170.659084:0:6739:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788581169 00002000:00010000:0.0:1788581170.659086:0:6739:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1788581170.659092:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd8d3873/0xf54e3944c2a70304 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9050 expref: 7 pid: 6722 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.659106:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd8d3873/0xf54e3944c2a70304 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9050 expref: 7 pid: 6722 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.659131:0:6739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd8d3873/0xf54e3944c2a70304 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9050 expref: 7 pid: 6722 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.659150:0:6739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581170.659154:0:6739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581170.659160:0:6739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a70351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.659182:0:6739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a70351 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.659220:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581170.659334:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995343104:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 319us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581170.659340:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 36 00010000:00010000:2.0:1788581170.659965:0:6723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a70351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.659981:0:6723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a70351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.660004:0:6723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a70351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.660009:0:6723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a70351 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.660014:0:6723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a70351 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.660019:0:6723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:2.0:1788581170.660022:0:6723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a70351 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.660027:0:6723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a70351 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.660037:0:6723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a70351 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.660042:0:6723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a70351 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581170.660106:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2372:x1875462995342848:12345-192.168.201.13@tcp:1:lfs.0 Request processed in 94047us (94277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581170.660112:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00100000:3.0:1788581170.663314:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581170.663556:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995343360 00000100:00100000:2.0:1788581170.663569:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995343360 00000100:00100000:2.0:1788581170.663638:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:2.0:1788581170.663763:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:10322:x1875462995343360:12345-192.168.201.13@tcp:35:lfs.0 00000004:00010000:2.0:1788581170.663839:0:5879:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70343 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d906c expref: 19 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581170.664168:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788581170.664230:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788581170.665121:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788581170.665185:0:5879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70358 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.665204:0:5879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a702e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9042 expref: 23 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.665213:0:5879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70358 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.666264:0:5879:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a702e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9042 expref: 23 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.666295:0:5879:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a702e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9042 expref: 23 pid: 9658 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581170.666313:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5879:1875463014253952:192.168.201.13@tcp:104: 00000100:00100000:3.0:1788581170.666423:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c915180 going to sleep for 11 seconds 00000100:00100000:3.0:1788581170.669340:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581170.669448:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995343488 00000100:00100000:2.0:1788581170.669459:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995343488 00010000:00010000:2.0:1788581170.669501:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a702e8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9042 expref: 24 pid: 9658 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581170.669548:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:2.0:1788581170.669573:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+24:2374:x1875462995343488:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581170.669590:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581170.669597:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a702e8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9042 expref: 24 pid: 9658 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.669610:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a702e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9042 expref: 24 pid: 9658 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.669636:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905c6f1c00) 00010000:00010000:2.0:1788581170.669642:0:5863:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70358 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.669668:0:5863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70358 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.669675:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70358 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581170.669692:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581170.669742:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+24:2374:x1875462995343488:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 171us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581170.669749:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 37 00010000:00010000:0.0:1788581170.670810:0:5879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a702e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9042 expref: 23 pid: 9658 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581170.670832:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5879:1875463014253952:192.168.201.13@tcp:104: 00010000:00010000:0.0:1788581170.670854:0:5879:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70358 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.670864:0:5879:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70358 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.670871:0:5879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70358 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788581170.671011:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788581170.671296:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788581170.671736:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5879:1875463014254080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788581170.671854:0:5879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581170.671891:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set ffff91905fd896c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581170.672014:0:5881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014254080 00000100:00100000:0.0:1788581170.672021:0:5881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014254080 00000100:00100000:0.0:1788581170.672071:0:5881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788581170.672080:0:5881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5879:x1875463014254080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788581170.672169:0:5881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5879:x1875463014254080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 90us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581170.672176:0:5881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581170.672296:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5879:1875463014254080:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788581170.672960:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788581170.673033:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5879:1875463014254208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788581170.673084:0:5879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581170.673111:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f8b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788581170.673699:0:5882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014254208 00000100:00100000:1.0:1788581170.673709:0:5882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014254208 00000100:00100000:1.0:1788581170.673748:0:5882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581170.673759:0:5882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5879:x1875463014254208:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788581170.674064:0:5882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5879:x1875463014254208:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 305us (978us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788581170.674073:0:5882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581170.674468:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5879:1875463014254208:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788581170.674534:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788581170.674579:0:5879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70358 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.674591:0:5879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70358 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.674600:0:5879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70358 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.674606:0:5879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb82e00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581170.674611:0:5879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70358 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.674635:0:5879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70358 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.674786:0:5879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905c6f1c00) 00010000:00010000:3.0:1788581170.674791:0:5879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788581170.674796:0:5879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70358 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581170.674803:0:5879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70358 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788581170.675014:0:5879:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788581170.675855:0:5879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788581170.675873:0:5879:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 386916629605ns, next at 387916626420ns, rc = 0 00000001:00080000:3.0:1788581170.675887:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788581170.675941:0:5879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905c6f1c00) 00010000:00010000:3.0:1788581170.675946:0:5879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788581170.675955:0:5879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70343 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d906c expref: 27 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581170.676097:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+26:10322:x1875462995343360:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 12449us (12792us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788581170.676107:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00000020:00080000:3.0:1788581170.676112:0:5879:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788581170.680775:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581170.680851:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995343616 00000100:00100000:0.0:1788581170.680864:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995343616 00000100:00100000:0.0:1788581170.680925:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:0.0:1788581170.680934:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+26:10322:x1875462995343616:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1788581170.680957:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581170.680981:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22e00/0xf54e3944c2a7035f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9073 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.681043:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22e00/0xf54e3944c2a7035f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9073 expref: 27 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.681058:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22e00/0xf54e3944c2a7035f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9073 expref: 27 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.681075:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:0.0:1788581170.681078:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788581170.681082:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22e00, rc 0) 00000100:00100000:0.0:1788581170.681143:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+27:10322:x1875462995343616:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 209us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581170.681150:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:1.0:1788581170.684982:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581170.685072:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995343872 00000100:00100000:0.0:1788581170.685083:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995343872 00000100:00100000:0.0:1788581170.685140:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:0.0:1788581170.685150:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904dc13850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+27:10322:x1875462995343872:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:0.0:1788581170.685567:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904dc13850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+28:10322:x1875462995343872:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 416us (592us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788581170.685575:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:3.0:1788581170.823595:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581170.823687:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995344128 00000100:00100000:0.0:1788581170.823700:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995344128 00000100:00100000:0.0:1788581170.823768:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:0.0:1788581170.823779:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+28:10332:x1875462995344128:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1788581170.823803:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581170.823823:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70366 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d907a expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581170.823917:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788581170.824043:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70366 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d907a expref: 30 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.824058:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525000) 00010000:00010000:0.0:1788581170.824061:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581170.824066:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70366 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d907a expref: 30 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.824078:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22400, rc 0) 00000100:00100000:0.0:1788581170.824145:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+29:10332:x1875462995344128:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 367us (561us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788581170.824152:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:2.0:1788581170.846796:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581170.846892:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995344256 00000100:00100000:0.0:1788581170.846901:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995344256 00000100:00100000:0.0:1788581170.846959:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 47 00000100:00100000:0.0:1788581170.846985:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+29:10332:x1875462995344256:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:0.0:1788581170.847064:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70374 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847092:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70374 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847106:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70374 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847123:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a7037b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847130:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a7037b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847136:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a7037b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847443:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70382 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847452:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847460:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581170.847506:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847519:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70374 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847532:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70374 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847540:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70374 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847545:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581170.847550:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70374 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847558:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70374 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847570:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:0.0:1788581170.847572:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581170.847576:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70374 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847582:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70374 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847596:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a7037b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847602:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a7037b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847608:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a7037b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847613:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581170.847620:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a7037b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847626:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a7037b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847633:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91904995ac00) 00010000:00010000:0.0:1788581170.847635:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581170.847637:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a7037b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847643:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a7037b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847655:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847660:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70382 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847666:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70382 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847671:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581170.847674:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70382 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847679:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70382 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847685:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:0.0:1788581170.847687:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581170.847693:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70382 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.847699:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70382 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581170.847845:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+29:10332:x1875462995344256:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 854us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581170.847853:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 47 00000100:00100000:1.0:1788581170.853185:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581170.853418:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995344512 00000100:00100000:3.0:1788581170.853433:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995344512 00000100:00100000:3.0:1788581170.853544:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:3.0:1788581170.853554:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+29:10332:x1875462995344512:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:3.0:1788581170.853796:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+30:10332:x1875462995344512:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 243us (666us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788581170.853804:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:2.0:1788581170.917823:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581170.917969:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995344768 00000100:00100000:0.0:1788581170.917979:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995344768 00000100:00100000:0.0:1788581170.918049:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:0.0:1788581170.918060:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+30:10335:x1875462995344768:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1788581170.918085:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581170.918102:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70389 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9081 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.918177:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70390 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.918192:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70390 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.918204:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70390 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.918216:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70397 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.918221:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919078:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919223:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7039e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919266:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7039e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919272:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7039e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581170.919284:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788581170.919378:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70390 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919383:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70390 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919388:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70390 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919391:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581170.919395:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70390 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919399:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70390 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919409:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:0.0:1788581170.919411:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581170.919421:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70390 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919425:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70390 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919438:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919445:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70397 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919451:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919456:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581170.919459:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919463:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70397 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919471:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91904995ac00) 00010000:00010000:0.0:1788581170.919473:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581170.919476:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70397 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919482:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70397 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919535:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70389 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9081 expref: 33 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919562:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7039e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9081 expref: 32 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.919569:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:0.0:1788581170.919571:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581170.919574:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc23a00, rc 0) 00000100:00100000:0.0:1788581170.919774:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+32:10335:x1875462995344768:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1713us (1960us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788581170.919783:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:2.0:1788581170.925365:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581170.925464:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995344896 00000100:00100000:0.0:1788581170.925475:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995344896 00000100:00100000:0.0:1788581170.925598:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:0.0:1788581170.925609:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+32:10335:x1875462995344896:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:0.0:1788581170.925703:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.925720:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.925733:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.925759:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.925766:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.925792:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.925798:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581170.925802:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.925810:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.925823:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:0.0:1788581170.925826:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581170.925830:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581170.925836:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581170.925918:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+32:10335:x1875462995344896:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 310us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581170.925926:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:2.0:1788581170.928461:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581170.928809:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995345152 00000100:00100000:3.0:1788581170.928819:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995345152 00000100:00100000:3.0:1788581170.928881:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:3.0:1788581170.928891:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+32:10335:x1875462995345152:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:3.0:1788581170.929139:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+33:10335:x1875462995345152:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 248us (686us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788581170.930103:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00010000:00010000:0.0:1788581171.258659:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581171.346332:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581171.346432:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995345408 00000100:00100000:3.0:1788581171.346444:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995345408 00000100:00100000:3.0:1788581171.346501:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:3.0:1788581171.346513:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+33:10366:x1875462995345408:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:3.0:1788581171.346540:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581171.346563:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a703b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9088 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.346680:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.346697:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.346711:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581171.346754:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788581171.346926:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a703b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9088 expref: 36 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.346951:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9088 expref: 35 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.346961:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:3.0:1788581171.346964:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581171.346968:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190414b3400, rc 0) 00000100:00100000:3.0:1788581171.347052:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+35:10366:x1875462995345408:12345-192.168.201.13@tcp:101:cat.0 Request processed in 541us (730us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788581171.347059:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:2.0:1788581171.362431:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581171.362532:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995345664 00000100:00100000:3.0:1788581171.362542:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995345664 00000100:00100000:3.0:1788581171.362675:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:3.0:1788581171.362686:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+35:10366:x1875462995345664:12345-192.168.201.13@tcp:35:cat.0 00000100:00100000:1.0:1788581171.363073:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581171.363288:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995345792 00000100:00100000:0.0:1788581171.363294:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995345792 00000100:00100000:0.0:1788581171.363339:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:0.0:1788581171.363348:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049af2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+36:2373:x1875462995345792:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581171.363359:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581171.363388:0:6739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9088 expref: 36 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.363422:0:6739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:0.0:1788581171.363432:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581171.363490:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049af2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+35:2373:x1875462995345792:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 142us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581171.363497:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:3.0:1788581171.365418:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+35:10366:x1875462995345664:12345-192.168.201.13@tcp:35:cat.0 Request processed in 2724us (2987us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788581171.365431:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:1.0:1788581171.461879:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581171.462278:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995346048 00000100:00100000:3.0:1788581171.462289:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995346048 00000100:00100000:3.0:1788581171.462355:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 51 00000100:00100000:3.0:1788581171.462366:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+35:10372:x1875462995346048:12345-192.168.201.13@tcp:101:dd.0 00010000:00010000:3.0:1788581171.462391:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581171.462408:0:9658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788581171.462438:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70320 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d905e expref: 35 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.462457:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:3.0:1788581171.462462:0:9658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581171.462477:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a703c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d908f expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.462585:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.462600:0:9658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7039e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9081 expref: 35 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.462609:0:9658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703cf lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.462654:0:9658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7039e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9081 expref: 35 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.462667:0:9658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7039e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9081 expref: 35 pid: 5878 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581171.462680:0:9658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f859500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9658:1875463014254336:192.168.201.13@tcp:104: 00000100:00100000:3.0:1788581171.462774:0:9658:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f8b9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581171.472683:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581171.472720:0:9658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f859500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9658:1875463014254336:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581171.472751:0:9658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581171.472803:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995346176 00000100:00100000:0.0:1788581171.472811:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995346176 00010000:00010000:0.0:1788581171.472850:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7039e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9081 expref: 36 pid: 5878 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581171.472893:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 38 00000100:00100000:0.0:1788581171.472903:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+36:2375:x1875462995346176:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581171.472919:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581171.472927:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7039e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9081 expref: 36 pid: 5878 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.472939:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7039e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9081 expref: 36 pid: 5878 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.473128:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a7039e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9081 expref: 36 pid: 5878 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.473145:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:0.0:1788581171.473150:0:5863:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.473169:0:5863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.473176:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703cf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.473204:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581171.473262:0:9658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.473270:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581171.473292:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:0.0:1788581171.473346:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+35:2375:x1875462995346176:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 443us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581171.473353:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 38 00010000:00010000:3.0:1788581171.473474:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a703c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d908f expref: 36 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.473490:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d908f expref: 35 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.473498:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:3.0:1788581171.473500:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788581171.473503:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190414b3400, rc 0) 00000100:00100000:3.0:1788581171.473530:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+35:10372:x1875462995346048:12345-192.168.201.13@tcp:101:dd.0 Request processed in 11166us (11663us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788581171.473537:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 51 00000100:00100000:2.0:1788581171.481589:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581171.481874:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995346432 00000100:00100000:3.0:1788581171.481885:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995346432 00000100:00100000:3.0:1788581171.481934:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 52 00000100:00100000:3.0:1788581171.481944:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+35:10372:x1875462995346432:12345-192.168.201.13@tcp:36:dd.0 00010000:00010000:3.0:1788581171.482209:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a703dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.482235:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a703dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.482287:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a703dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788581171.482341:0:5876:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1788581171.482366:0:5876:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002880ea6a reply state 0000000072eafadc transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a703dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581171.482374:0:5876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788581171.482467:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+38:10372:x1875462995346432:12345-192.168.201.13@tcp:36:dd.0 Request processed in 523us (887us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788581171.482474:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 52 00000020:00080000:3.0:1788581171.482479:0:5876:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788581171.485882:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a703dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.485900:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a703dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.485919:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a703dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.485926:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413ffc00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581171.485932:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a703dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.485941:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a703dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.485962:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:0.0:1788581171.485966:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581171.485971:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a703dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.485999:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a703dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581171.869275:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581171.869562:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995346560 00000100:00100000:0.0:1788581171.869575:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995346560 00000100:00100000:0.0:1788581171.869653:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 53 00000100:00100000:0.0:1788581171.869664:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+37:10386:x1875462995346560:12345-192.168.201.13@tcp:101:stat.0 00010000:00010000:0.0:1788581171.869692:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581171.869714:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a703e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9096 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.869783:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.870030:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.870046:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.870065:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a703f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.870072:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a703f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.870079:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a703f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.870173:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a703f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.870199:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d908f expref: 38 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.870207:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a703f9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.870278:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d908f expref: 38 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.870294:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d908f expref: 38 pid: 9658 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581171.870311:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5877:1875463014254464:192.168.201.13@tcp:104: 00000100:00100000:0.0:1788581171.870476:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff91905fd89180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581171.899360:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5877:1875463014254464:192.168.201.13@tcp:104: 00010000:00010000:0.0:1788581171.899399:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a703f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581171.901942:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581171.902067:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995346816 00000100:00100000:1.0:1788581171.902080:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995346816 00000100:00100000:1.0:1788581171.902149:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:1.0:1788581171.902160:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+39:5611:x1875462995346816:12345-192.168.201.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788581171.902547:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+40:5611:x1875462995346816:12345-192.168.201.13@tcp:35:ldlm_bl.0 Request processed in 387us (612us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788581171.902554:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:2.0:1788581171.906638:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581171.906807:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995346944 00000100:00100000:0.0:1788581171.906817:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995346944 00010000:00010000:0.0:1788581171.906861:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d908f expref: 40 pid: 9658 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581171.906908:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 39 00000100:00100000:0.0:1788581171.906918:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+40:2374:x1875462995346944:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581171.906933:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581171.906968:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d908f expref: 40 pid: 9658 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.906983:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d908f expref: 40 pid: 9658 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.907007:0:6739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a703cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d908f expref: 40 pid: 9658 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.907028:0:6739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:0.0:1788581171.907033:0:6739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a703f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.907042:0:6739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a703f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.907049:0:6739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a703f9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581171.907081:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581171.907144:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+39:2374:x1875462995346944:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 226us (516us total) trans 0 rc 0/0 00010000:00010000:3.0:1788581171.907149:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a703f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581171.907154:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 39 00010000:00010000:3.0:1788581171.907165:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a703f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581171.907221:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788581171.907226:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581171.907316:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a703f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907333:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a703f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907343:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907350:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907369:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907375:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581171.907380:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907388:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907400:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:3.0:1788581171.907404:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581171.907407:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907413:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a703eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907427:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a703f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907433:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a703f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907440:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a703f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907445:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581171.907448:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a703f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907465:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a703f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907475:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91904995ac00) 00010000:00010000:3.0:1788581171.907478:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581171.907482:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a703f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907488:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a703f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907534:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a703e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9096 expref: 39 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907553:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a703f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9096 expref: 38 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581171.907561:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:3.0:1788581171.907564:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581171.907566:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22400, rc 0) 00000100:00100000:3.0:1788581171.907602:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+38:10386:x1875462995346560:12345-192.168.201.13@tcp:101:stat.0 Request processed in 37940us (38363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581171.907611:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 53 00000100:00100000:2.0:1788581172.008985:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581172.009090:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995347200 00000100:00100000:3.0:1788581172.009102:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995347200 00000100:00100000:3.0:1788581172.009198:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 54 00000100:00100000:3.0:1788581172.009284:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+38:10392:x1875462995347200:12345-192.168.201.13@tcp:36:truncate.0 00010000:00010000:3.0:1788581172.009369:0:5876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581172.009400:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a703f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9096 expref: 38 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.009420:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:3.0:1788581172.009425:0:5876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581172.009667:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70400 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.009682:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70400 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.009694:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70400 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788581172.009755:0:5876:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788581172.009782:0:5876:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3760584 reply state 00000000470f1bc9 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70400 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581172.009792:0:5876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788581172.009921:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+40:10392:x1875462995347200:12345-192.168.201.13@tcp:36:truncate.0 Request processed in 712us (946us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788581172.009929:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 54 00000020:00080000:3.0:1788581172.009934:0:5876:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1788581172.010085:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788581172.013963:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70400 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.013982:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70400 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.013990:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70400 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.014010:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413ff200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581172.014015:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70400 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.014023:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70400 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.014043:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:0.0:1788581172.014046:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581172.014050:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70400 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.014056:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70400 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788581172.016615:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788581172.180153:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581172.185879:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995347328 00000100:00100000:3.0:1788581172.186005:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995347328 00000100:00100000:3.0:1788581172.186381:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 55 00000100:00100000:3.0:1788581172.186394:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+39:10406:x1875462995347328:12345-192.168.201.13@tcp:101:stat.0 00010000:00010000:3.0:1788581172.186456:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581172.186489:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a70407 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d909d expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186569:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7040e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186585:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7040e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186599:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7040e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186616:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70415 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186623:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186629:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186717:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a7041c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186727:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a7041c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186734:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a7041c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581172.186781:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788581172.186791:0:9658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581172.186815:0:9658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a7041c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186827:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a7041c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186836:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7040e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186842:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7040e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186848:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7040e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186854:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413ff200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581172.186858:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7040e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186866:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7040e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186878:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:3.0:1788581172.186880:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581172.186884:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7040e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186890:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7040e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186917:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186935:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70415 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.186941:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70415 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.187403:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413ffc00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581172.187411:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70415 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.187418:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70415 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.187428:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff919052341500) 00010000:00010000:3.0:1788581172.187431:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581172.187433:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70415 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.187438:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a70415 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.187481:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a70407 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d909d expref: 41 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.187495:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a7041c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d909d expref: 40 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.187501:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:3.0:1788581172.187504:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581172.187514:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190414b3400, rc 0) 00000100:00100000:3.0:1788581172.187610:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+40:10406:x1875462995347328:12345-192.168.201.13@tcp:101:stat.0 Request processed in 1218us (7466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581172.187627:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 55 00010000:00010000:3.0:1788581172.272968:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581172.286587:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581172.286814:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995347584 00000100:00100000:1.0:1788581172.286824:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995347584 00000100:00100000:1.0:1788581172.286883:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 56 00000100:00100000:1.0:1788581172.286893:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+40:10416:x1875462995347584:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1788581172.286930:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581172.286952:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70423 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d90a4 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581172.287057:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788581172.287192:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70423 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90a4 expref: 42 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.287220:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525000) 00010000:00010000:1.0:1788581172.287223:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581172.287228:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70423 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90a4 expref: 42 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.287272:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9c00, rc 0) 00000100:00100000:1.0:1788581172.287341:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+41:10416:x1875462995347584:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 448us (764us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1788581172.287349:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 56 00000100:00100000:2.0:1788581172.291625:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581172.291766:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995347840 00000100:00100000:1.0:1788581172.291776:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995347840 00000100:00100000:1.0:1788581172.291841:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:1.0:1788581172.291853:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+41:10416:x1875462995347840:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:1.0:1788581172.292119:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+42:10416:x1875462995347840:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 267us (504us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788581172.292127:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:3.0:1788581172.335581:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581172.335607:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014254592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581172.335692:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581172.335897:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014254592 00000100:00100000:1.0:1788581172.335907:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014254592 00000100:00100000:1.0:1788581172.335974:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788581172.336013:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014254592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581172.336051:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581172.336102:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014254592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581172.336110:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788581172.336483:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581172.336528:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014254592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581172.419783:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581172.419865:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995348096 00000100:00100000:0.0:1788581172.419877:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995348096 00000100:00100000:0.0:1788581172.419939:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 57 00000100:00100000:0.0:1788581172.419949:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+42:10422:x1875462995348096:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:0.0:1788581172.419973:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581172.420003:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70431 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d90ab expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.420132:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70438 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.420147:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a7041c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d909d expref: 43 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.420167:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70438 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.420214:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a7041c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d909d expref: 43 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.420228:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a7041c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d909d expref: 43 pid: 9658 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581172.420240:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5877:1875463014254720:192.168.201.13@tcp:104: 00000100:00100000:0.0:1788581172.420383:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff91905fd89180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581172.422565:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5877:1875463014254720:192.168.201.13@tcp:104: 00010000:00010000:0.0:1788581172.422597:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70438 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581172.423680:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581172.428517:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995348224 00000100:00100000:3.0:1788581172.428535:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995348224 00010000:00010000:3.0:1788581172.428594:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a7041c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d909d expref: 44 pid: 9658 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581172.428632:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 40 00000100:00100000:3.0:1788581172.428641:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+44:2374:x1875462995348224:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581172.428657:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581172.428664:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a7041c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d909d expref: 44 pid: 9658 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.428677:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a7041c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d909d expref: 44 pid: 9658 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.428700:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a7041c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d909d expref: 44 pid: 9658 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.428721:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:3.0:1788581172.428741:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70438 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.428751:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70438 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.428758:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70438 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.428875:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581172.428955:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+43:2374:x1875462995348224:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 314us (5281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581172.428963:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 40 00010000:00010000:1.0:1788581172.431844:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70438 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.431862:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70438 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581172.431888:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788581172.432198:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70431 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ab expref: 44 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.432231:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70438 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ab expref: 43 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.432240:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:1.0:1788581172.432366:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788581172.432370:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22800, rc 0) 00000100:00100000:1.0:1788581172.432460:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+43:10422:x1875462995348096:12345-192.168.201.13@tcp:101:bash.0 Request processed in 12511us (12685us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1788581172.432470:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 57 00000100:00100000:2.0:1788581172.439978:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581172.440343:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995348480 00000100:00100000:3.0:1788581172.440356:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995348480 00000100:00100000:3.0:1788581172.440422:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 58 00000100:00100000:3.0:1788581172.440436:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+43:10422:x1875462995348480:12345-192.168.201.13@tcp:36:bash.0 00010000:00010000:3.0:1788581172.440734:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70446 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.440752:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.440764:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788581172.440818:0:5876:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1788581172.440842:0:5876:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006bc4d3d9 reply state 000000002cac07bb transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581172.440851:0:5876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788581172.440962:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+46:10422:x1875462995348480:12345-192.168.201.13@tcp:36:bash.0 Request processed in 529us (993us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788581172.440970:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 58 00000020:00080000:3.0:1788581172.440975:0:5876:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788581172.444595:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.444615:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70446 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.444633:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70446 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.444640:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b3400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581172.444645:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70446 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.444673:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70446 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.444693:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:0.0:1788581172.444695:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581172.444700:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70446 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581172.444706:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70446 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581172.453286:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581172.453415:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995348608 00000100:00100000:3.0:1788581172.453428:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995348608 00000100:00100000:3.0:1788581172.453501:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 59 00000100:00100000:3.0:1788581172.453514:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+45:10422:x1875462995348608:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1788581172.453544:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581172.453571:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7044d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d90b2 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.453675:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70454 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.453690:0:9658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70438 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ab expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.453699:0:9658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70454 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.453739:0:9658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70438 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ab expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.453755:0:9658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70438 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ab expref: 46 pid: 5877 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581172.453769:0:9658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f859c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9658:1875463014254848:192.168.201.13@tcp:104: 00000100:00100000:3.0:1788581172.453869:0:9658:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f8b9240 going to sleep for 11 seconds 00000100:00100000:2.0:1788581172.463115:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581172.463233:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995348736 00000100:00100000:1.0:1788581172.463286:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995348736 00010000:00010000:1.0:1788581172.463331:0:5862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70438 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ab expref: 47 pid: 5877 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581172.463400:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:1.0:1788581172.463411:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+47:2375:x1875462995348736:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581172.463427:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581172.463435:0:5862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70438 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ab expref: 47 pid: 5877 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.463447:0:5862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70438 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ab expref: 47 pid: 5877 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.463469:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:1.0:1788581172.463474:0:5862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70454 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.463483:0:5862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.463491:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70454 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.463512:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581172.463572:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+47:2375:x1875462995348736:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 162us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581172.463579:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 41 00010000:00010000:3.0:1788581172.467883:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70438 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ab expref: 46 pid: 5877 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581172.467911:0:9658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f859c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9658:1875463014254848:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581172.467937:0:9658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.467948:0:9658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.467954:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581172.468005:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788581172.468010:0:9658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581172.468034:0:9658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.468069:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7044d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90b2 expref: 46 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.468085:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70454 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90b2 expref: 45 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.468093:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:3.0:1788581172.468096:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581172.468099:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190414b3400, rc 0) 00000100:00100000:3.0:1788581172.468173:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+45:10422:x1875462995348608:12345-192.168.201.13@tcp:101:bash.0 Request processed in 14662us (14927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581172.468182:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 59 00000100:00100000:2.0:1788581172.478972:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581172.479094:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995348992 00000100:00100000:1.0:1788581172.479106:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995348992 00000100:00100000:1.0:1788581172.479167:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:1.0:1788581172.479179:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904dc12850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+45:10422:x1875462995348992:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:1.0:1788581172.479489:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904dc12850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+46:10422:x1875462995348992:12345-192.168.201.13@tcp:35:bash.0 Request processed in 311us (525us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788581172.479498:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:2.0:1788581172.592330:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581172.592419:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995349248 00000100:00100000:3.0:1788581172.592431:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995349248 00000100:00100000:3.0:1788581172.592504:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 60 00000100:00100000:3.0:1788581172.592516:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+46:10432:x1875462995349248:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581172.592547:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581172.592569:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7045b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d90b9 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581172.592686:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788581172.592836:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7045b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90b9 expref: 48 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.592852:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525000) 00010000:00010000:3.0:1788581172.592856:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581172.592863:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7045b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90b9 expref: 48 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.592878:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190414b2800, rc 0) 00000100:00100000:3.0:1788581172.592952:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+47:10432:x1875462995349248:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 438us (635us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788581172.592959:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 60 00000100:00100000:2.0:1788581172.605539:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581172.605653:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995349376 00000100:00100000:1.0:1788581172.605664:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995349376 00000100:00100000:1.0:1788581172.605725:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 61 00000100:00100000:1.0:1788581172.605736:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+47:10432:x1875462995349376:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:1.0:1788581172.605828:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70469 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.605848:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70469 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.605862:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70469 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.605878:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70470 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.605886:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.605893:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.605985:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70477 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606007:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606027:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788581172.606070:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606082:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70469 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606088:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70469 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606094:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70469 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606100:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8e00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581172.606104:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70469 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606111:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70469 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606124:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:1.0:1788581172.606128:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581172.606133:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70469 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606139:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70469 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606153:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606166:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70470 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606172:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606177:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581172.606180:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606186:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70470 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606195:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91905c6f1f00) 00010000:00010000:1.0:1788581172.606197:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581172.606211:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70470 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606216:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70470 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606232:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606237:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70477 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606296:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70477 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606301:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9c00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581172.606311:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70477 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606317:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70477 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606326:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:1.0:1788581172.606329:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581172.606332:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70477 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.606338:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70477 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581172.606438:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+47:10432:x1875462995349376:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 703us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581172.606446:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 61 00000100:00100000:2.0:1788581172.609917:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581172.612946:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995349632 00000100:00100000:1.0:1788581172.612965:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995349632 00000100:00100000:1.0:1788581172.613044:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:1.0:1788581172.613057:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+47:10432:x1875462995349632:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:1.0:1788581172.613351:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+48:10432:x1875462995349632:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 295us (3450us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788581172.613359:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:0.0:1788581172.692855:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581172.692942:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995349888 00000100:00100000:3.0:1788581172.692953:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995349888 00000100:00100000:3.0:1788581172.693030:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 62 00000100:00100000:3.0:1788581172.693042:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+48:10435:x1875462995349888:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581172.693067:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581172.693089:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7047e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d90c0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693206:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a70485 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693220:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a70485 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693239:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a70485 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693280:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a7048c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693287:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a7048c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693293:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a7048c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693415:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70493 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693425:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693431:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581172.693442:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788581172.693537:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a70485 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693545:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a70485 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693558:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a70485 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693564:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413ff000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581172.693569:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a70485 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693576:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a70485 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693589:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:3.0:1788581172.693593:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581172.693597:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a70485 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693603:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a70485 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693618:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a7048c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693623:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a7048c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693629:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a7048c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693634:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413ffc00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581172.693636:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a7048c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693651:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a7048c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693660:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff919052341500) 00010000:00010000:3.0:1788581172.693662:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581172.693665:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a7048c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693670:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a7048c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693716:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a7047e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90c0 expref: 51 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693731:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90c0 expref: 50 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.693737:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:3.0:1788581172.693740:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581172.693742:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413ff200, rc 0) 00000100:00100000:3.0:1788581172.693822:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+50:10435:x1875462995349888:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 782us (978us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788581172.693830:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 62 00000100:00100000:2.0:1788581172.697341:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581172.697384:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581172.697536:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995350144 00000100:00100000:1.0:1788581172.697548:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995350144 00000100:00100000:1.0:1788581172.697626:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 63 00000100:00100000:1.0:1788581172.697638:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+50:10435:x1875462995350144:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:1.0:1788581172.697737:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.697765:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.697777:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.697808:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.697814:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.697821:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.697827:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9c00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581172.697831:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.697838:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.697850:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:1.0:1788581172.697853:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581172.697858:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.697864:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581172.697947:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+50:10435:x1875462995350144:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 311us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581172.697961:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 63 00000100:00100000:3.0:1788581172.699369:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995350016 00000100:00100000:3.0:1788581172.699385:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995350016 00000100:00100000:3.0:1788581172.699478:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:3.0:1788581172.699489:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+50:2372:x1875462995350016:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581172.699526:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581172.699555:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a70493 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90c0 expref: 50 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.699578:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:3.0:1788581172.699583:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581172.699781:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+49:2372:x1875462995350016:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 293us (2451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581172.699788:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:2.0:1788581172.702483:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581172.702564:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995350400 00000100:00100000:1.0:1788581172.702576:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995350400 00000100:00100000:1.0:1788581172.702645:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:1.0:1788581172.702655:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+49:10435:x1875462995350400:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:1.0:1788581172.702904:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+50:10435:x1875462995350400:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 249us (431us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788581172.702912:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:0.0:1788581172.924340:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581172.929235:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995350656 00000100:00100000:3.0:1788581172.929297:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995350656 00000100:00100000:3.0:1788581172.929394:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 64 00000100:00100000:3.0:1788581172.929406:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+50:10453:x1875462995350656:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:3.0:1788581172.929434:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581172.929458:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a704a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d90c7 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.929562:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a704af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.929575:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a704af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.929588:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a704af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581172.929600:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788581172.929732:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a704a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90c7 expref: 53 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.929781:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a704af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90c7 expref: 52 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581172.929790:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:3.0:1788581172.929793:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788581172.929796:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413ffc00, rc 0) 00000100:00100000:3.0:1788581172.929872:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:10453:x1875462995350656:12345-192.168.201.13@tcp:101:cat.0 Request processed in 469us (5542us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788581172.929879:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 64 00000100:00100000:0.0:1788581172.977536:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581172.977656:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995350784 00000100:00100000:1.0:1788581172.977667:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995350784 00000100:00100000:1.0:1788581172.977747:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 65 00000100:00100000:1.0:1788581172.977759:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:10454:x1875462995350784:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1788581172.977786:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581172.977816:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d90ce expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.978208:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a704c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.978224:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a704c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.978235:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a704c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581172.978319:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788581172.978323:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788581172.978340:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a704c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.978387:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ce expref: 54 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.978409:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a704c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ce expref: 53 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581172.978418:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:1.0:1788581172.978421:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581172.978425:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8000, rc 0) 00000100:00100000:1.0:1788581172.978483:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+53:10454:x1875462995350784:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 726us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581172.978491:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 65 00000100:00100000:2.0:1788581172.989825:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581172.990639:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995351168 00000100:00100000:1.0:1788581172.990651:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995351168 00000100:00100000:1.0:1788581172.990720:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:1.0:1788581172.990730:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+53:10454:x1875462995351168:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:1.0:1788581172.991436:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:10454:x1875462995351168:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 703us (1616us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788581172.991445:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:0.0:1788581172.999807:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581173.000982:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995351296 00000100:00100000:1.0:1788581173.000995:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995351296 00000100:00100000:1.0:1788581173.001077:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:1.0:1788581173.001087:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:10454:x1875462995351296:12345-192.168.201.13@tcp:103:lfs.0 00010000:00010000:1.0:1788581173.001102:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788581173.001129:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a70454 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90b2 expref: 54 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.001169:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a704af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90c7 expref: 53 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.001185:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22e00/0xf54e3944c2a7035f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9073 expref: 52 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.001206:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91904995aa00) 00010000:00010000:1.0:1788581173.001216:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581173.001336:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+51:10454:x1875462995351296:12345-192.168.201.13@tcp:103:lfs.0 Request processed in 250us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581173.001344:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:0.0:1788581173.003832:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581173.004139:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995351424 00000100:00100000:3.0:1788581173.004150:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995351424 00000100:00100000:3.0:1788581173.004225:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 66 00000100:00100000:3.0:1788581173.004237:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+51:10454:x1875462995351424:12345-192.168.201.13@tcp:58:lfs.0 00010000:00010000:3.0:1788581173.004388:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a704cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.004406:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a704cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.004418:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a704cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788581173.004724:0:5876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581173.008132:0:5876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788581173.008265:0:5876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788581173.008409:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+51:10454:x1875462995351424:12345-192.168.201.13@tcp:58:lfs.0 Request processed in 4167us (4578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581173.008432:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 66 00000040:00080000:3.0:1788581173.040580:0:11735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788581173.040589:0:11735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788581173.040676:0:11735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788581173.040683:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788581173.040806:0:11735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f859c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11735:1875463014254976:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788581173.040985:0:11735:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f8b9480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581173.047569:0:11735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f859c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11735:1875463014254976:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788581173.055100:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581173.055789:0:5887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995351552 00000100:00100000:1.0:1788581173.055801:0:5887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995351552 00000100:00100000:1.0:1788581173.055911:0:5887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:1.0:1788581173.055923:0:5887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:11f1870a-1d9b-4af2-bb25-e81f8742df75+51:10458:x1875462995351552:12345-192.168.201.13@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788581173.056012:0:5887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:11f1870a-1d9b-4af2-bb25-e81f8742df75+51:10458:x1875462995351552:12345-192.168.201.13@tcp:900:lhsmtool_posix.0 Request processed in 91us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581173.056020:0:5887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:2.0:1788581173.068002:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581173.068048:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995351680 00000100:00100000:2.0:1788581173.068058:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995351680 00000100:00100000:2.0:1788581173.068105:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 67 00000100:00100000:2.0:1788581173.068114:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+51:10458:x1875462995351680:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788581173.068147:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788581173.068295:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+51:10458:x1875462995351680:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 181us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581173.068317:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 67 00000100:00100000:2.0:1788581173.069601:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581173.069750:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995351808 00000100:00100000:3.0:1788581173.069759:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995351808 00000100:00100000:3.0:1788581173.069808:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 68 00000100:00100000:3.0:1788581173.069816:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+51:10456:x1875462995351808:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581173.069832:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581173.069853:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a704d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d90d5 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.069913:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a704d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.069928:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a704d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.069938:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a704d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.069953:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a704e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.069974:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a704e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.069981:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a704e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070062:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a704e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070069:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a704e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070076:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a704e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581173.070107:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788581173.070111:0:5878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581173.070127:0:5878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a704e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070137:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a704e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070144:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a704d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070150:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a704d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070156:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a704d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070172:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413ffc00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581173.070176:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a704d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070184:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a704d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070208:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:3.0:1788581173.070219:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581173.070223:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a704d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070229:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a704d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070263:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a704e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070269:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a704e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070275:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a704e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070279:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b3400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581173.070281:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a704e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070287:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a704e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070305:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff919052341400) 00010000:00010000:3.0:1788581173.070308:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581173.070311:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a704e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070317:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b3400/0xf54e3944c2a704e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070347:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a704d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90d5 expref: 53 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070359:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a704e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90d5 expref: 52 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.070366:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341500) 00010000:00010000:3.0:1788581173.070368:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581173.070370:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190414b2800, rc 0) 00000100:00100000:3.0:1788581173.070432:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:10456:x1875462995351808:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 617us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581173.070439:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 68 00000100:00100000:2.0:1788581173.079985:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581173.080172:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995351936 00000100:00100000:1.0:1788581173.080183:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995351936 00000100:00100000:1.0:1788581173.080294:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 69 00000100:00100000:1.0:1788581173.080307:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:10458:x1875462995351936:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788581173.080391:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704ee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080426:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080439:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080455:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a704f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080464:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a704f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080471:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a704f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080497:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a704fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080504:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a704fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080511:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a704fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581173.080548:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788581173.080552:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788581173.080567:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a704fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080578:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080594:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704ee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080600:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080621:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9c00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581173.080625:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080633:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704ee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080646:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91904995af00) 00010000:00010000:1.0:1788581173.080649:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581173.080653:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080659:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a704ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080673:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a704f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080679:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a704f5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080686:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a704f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080692:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8e00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581173.080701:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a704f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080708:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a704f5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080717:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff91905c6f1f00) 00010000:00010000:1.0:1788581173.080719:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581173.080722:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a704f5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080728:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a704f5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080743:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a704fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080750:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a704fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080756:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a704fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080762:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9e00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581173.080765:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a704fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080771:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a704fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080778:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341500) 00010000:00010000:1.0:1788581173.080781:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581173.080794:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a704fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.080800:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a704fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581173.080886:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:10458:x1875462995351936:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 Request processed in 581us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581173.080895:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 69 00000100:00100000:3.0:1788581173.088107:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581173.088230:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995352192 00000100:00100000:1.0:1788581173.088267:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995352192 00000100:00100000:1.0:1788581173.088329:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 70 00000100:00100000:1.0:1788581173.088341:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:10458:x1875462995352192:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581173.088363:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581173.088386:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70503 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d90dc expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.088488:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a7050a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.088502:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a7050a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.088514:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a7050a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581173.088525:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788581173.088628:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a7050a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.088637:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a7050a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.088658:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a7050a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.088665:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8e00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581173.088669:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a7050a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.088678:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a7050a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.088692:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341500) 00010000:00010000:1.0:1788581173.088695:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581173.088699:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a7050a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.088707:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a7050a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.088747:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70503 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90dc expref: 54 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.088758:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91904995af00) 00010000:00010000:1.0:1788581173.088761:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581173.088765:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70503 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90dc expref: 54 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.088775:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9e00, rc 0) 00000100:00100000:1.0:1788581173.088832:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+53:10458:x1875462995352192:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 494us (734us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788581173.088850:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 70 00000100:00100000:3.0:1788581173.096825:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581173.096884:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995352320 00000100:00100000:1.0:1788581173.096895:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995352320 00000100:00100000:1.0:1788581173.096961:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 71 00000100:00100000:1.0:1788581173.096972:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+53:10458:x1875462995352320:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788581173.097027:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788581173.097140:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+53:10458:x1875462995352320:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 169us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581173.097149:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 71 00000100:00100000:0.0:1788581173.111624:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581173.111763:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995352576 00000100:00100000:1.0:1788581173.111774:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995352576 00000100:00100000:1.0:1788581173.111851:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 72 00000100:00100000:1.0:1788581173.111862:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+53:10458:x1875462995352576:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581173.111884:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581173.111887:0:5878:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788581173.111919:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a704c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ce expref: 53 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.111940:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:1.0:1788581173.111945:0:5878:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581173.111959:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70518 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d90e3 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788581173.112419:0:5878:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788581173.112626:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a7051f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.112653:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a7051f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.112663:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a7051f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.112714:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70518 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90e3 expref: 55 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.112730:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a7051f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90e3 expref: 54 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.112739:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91905c6f1f00) 00010000:00010000:1.0:1788581173.112742:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581173.112745:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8e00, rc 0) 00000100:00100000:1.0:1788581173.112818:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:10458:x1875462995352576:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 957us (1203us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788581173.112826:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 72 00000100:00100000:3.0:1788581173.132969:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581173.133160:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995352832 00000100:00100000:1.0:1788581173.133171:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995352832 00000100:00100000:1.0:1788581173.133287:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 73 00000100:00100000:1.0:1788581173.133298:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:10458:x1875462995352832:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788581173.133357:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581173.133385:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a7051f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90e3 expref: 54 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133404:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91905c6f1f00) 00010000:00010000:1.0:1788581173.133430:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581173.133452:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a7052d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133464:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a7052d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133474:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a7052d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133487:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70534 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xeed8ef8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133494:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeed8ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133499:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeed8ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133565:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a7052d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133572:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a7052d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133578:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a7052d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133583:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9e00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581173.133587:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a7052d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133593:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a7052d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133623:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:1.0:1788581173.133625:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581173.133629:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a7052d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133635:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a7052d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133645:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeed8ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133651:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70534 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeed8ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133656:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70534 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeed8ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133661:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581173.133663:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70534 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeed8ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133670:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70534 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeed8ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133677:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xeed8ef8 (ffff91905c6f1600) 00010000:00010000:1.0:1788581173.133679:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581173.133681:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70534 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xeed8ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.133687:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70534 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xeed8ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581173.134891:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+53:10458:x1875462995352832:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 1587us (1926us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581173.134903:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 73 00000100:00100000:3.0:1788581173.148688:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581173.153958:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995352960 00000100:00100000:2.0:1788581173.153976:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995352960 00000100:00100000:3.0:1788581173.156519:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 74 00000100:00100000:3.0:1788581173.156540:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+53:10458:x1875462995352960:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581173.156562:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581173.156602:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a7053b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d90ea expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.156644:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70542 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.156657:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.156669:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.156777:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a7053b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ea expref: 55 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.156797:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ea expref: 54 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.156996:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919052341400) 00010000:00010000:3.0:1788581173.157014:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788581173.157017:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf800, rc 0) 00000100:00100000:3.0:1788581173.157173:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:10458:x1875462995352960:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 640us (8493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581173.157181:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 74 00000100:00100000:0.0:1788581173.170686:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581173.171395:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995353216 00000100:00100000:3.0:1788581173.171407:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995353216 00000100:00100000:3.0:1788581173.171518:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 75 00000100:00100000:3.0:1788581173.171527:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:10458:x1875462995353216:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788581173.171603:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70549 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.171629:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.171640:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788581173.175114:0:9658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788581173.175132:0:9658:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 389415888285ns, next at 390415885140ns, rc = 0 00000004:00010000:3.0:1788581173.177210:0:9658:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008631bced reply state 0000000070d72152 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581173.177230:0:9658:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788581173.178072:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+56:10458:x1875462995353216:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 6538us (7389us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788581173.178083:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 75 00000100:00100000:2.0:1788581173.185059:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581173.185140:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995353344 00000100:00100000:1.0:1788581173.185152:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995353344 00000100:00100000:1.0:1788581173.185223:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 76 00000100:00100000:1.0:1788581173.185236:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+56:10458:x1875462995353344:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581173.185356:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581173.185380:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70550 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d90f1 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.185443:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70550 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90f1 expref: 57 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.185457:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70550 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90f1 expref: 57 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.185478:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919052341400) 00010000:00010000:1.0:1788581173.185482:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788581173.185486:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8000, rc 0) 00000100:00100000:1.0:1788581173.185587:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:10458:x1875462995353344:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 354us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581173.185594:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 76 00010000:00010000:0.0:1788581173.189965:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.189983:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70549 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.189991:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70549 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.189997:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581173.190001:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70549 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.190024:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70549 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.190042:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919052341400) 00010000:00010000:0.0:1788581173.190044:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788581173.190048:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70549 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.190054:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70549 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581173.201006:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581173.201233:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995353472 00000100:00100000:3.0:1788581173.201271:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995353472 00000100:00100000:3.0:1788581173.201327:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 24 00000100:00100000:3.0:1788581173.201337:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2371:x1875462995353472:12345-192.168.201.13@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788581173.201372:0:10329:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp t0 exp 0000000000000000 cur 389 last 0 00000020:00000080:3.0:1788581173.201406:0:10329:0:(genops.c:1385:class_connect()) connect: client 11f1870a-1d9b-4af2-bb25-e81f8742df75, cookie 0xf54e3944c2a70557 00002000:00100000:3.0:1788581173.201418:0:10329:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 11f1870a-1d9b-4af2-bb25-e81f8742df75/ffff91904999e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788581173.201429:0:10329:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788581173.201691:0:10329:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788581173.201719:0:10329:0:(import.c:65:import_set_state_nolock()) ffff91904999f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581173.201802:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2371:x1875462995353472:12345-192.168.201.13@tcp:8:lhsmtool_posix.0 Request processed in 464us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581173.201822:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 24 00000100:00100000:0.0:1788581173.212121:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581173.212308:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995353600 00000100:00100000:3.0:1788581173.212319:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995353600 00000100:00100000:3.0:1788581173.212416:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 25 00000100:00100000:3.0:1788581173.212429:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:0:x1875462995353600:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788581173.212777:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788581173.309206:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581173.374338:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:0:x1875462995353600:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 161893us (162209us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788581173.374356:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 25 00000001:00080000:3.0:1788581173.374410:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:3.0:1788581173.374420:0:6750:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11f1870a-1d9b-4af2-bb25-e81f8742df75 00000100:00100000:2.0:1788581173.383501:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581173.383603:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995353856 00000100:00100000:0.0:1788581173.383614:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995353856 00000100:00100000:0.0:1788581173.383677:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:0.0:1788581173.383688:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+56:10458:x1875462995353856:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788581173.384519:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:10458:x1875462995353856:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 830us (1025us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788581173.384529:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:3.0:1788581173.393562:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581173.394462:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995354112 00000100:00100000:0.0:1788581173.394481:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995354112 00000100:00100000:0.0:1788581173.394596:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 77 00000100:00100000:0.0:1788581173.394609:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:10458:x1875462995354112:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788581173.394749:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:10458:x1875462995354112:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 142us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581173.394757:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 77 00000100:00100000:2.0:1788581173.420842:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581173.420968:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995354240 00000100:00100000:3.0:1788581173.420983:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995354240 00000100:00100000:3.0:1788581173.421070:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 78 00000100:00100000:3.0:1788581173.421083:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:10458:x1875462995354240:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581173.421113:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581173.421142:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a7055e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d90f8 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.421277:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70565 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.421294:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.421308:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581173.421372:0:5878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581173.421393:0:5878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.421421:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a7055e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90f8 expref: 59 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.421443:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70565 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90f8 expref: 58 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.421453:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919052341400) 00010000:00010000:3.0:1788581173.421456:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788581173.421460:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce000, rc 0) 00000100:00100000:3.0:1788581173.421529:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:10458:x1875462995354240:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 448us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581173.421537:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 78 00000100:00100000:3.0:1788581173.424887:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581173.424934:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995354368 00000100:00100000:0.0:1788581173.424952:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995354368 00000100:00100000:0.0:1788581173.425017:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 26 00000100:00100000:0.0:1788581173.425029:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f85a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995354368:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581173.425048:0:6722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581173.425071:0:6722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a7056c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d90ff expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788581173.425097:0:6722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b9534, blocks: 0x1 00010000:00010000:0.0:1788581173.425113:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=389s v=(0 0) 00010000:00010000:0.0:1788581173.425117:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581173.425141:0:6722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a7056c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ff expref: 6 pid: 6722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.425165:0:6722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a7056c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ff expref: 6 pid: 6722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.425180:0:6722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22600, rc 0) 00000100:00100000:0.0:1788581173.426874:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f85a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995354368:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 1838us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581173.426887:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 26 00000100:00100000:1.0:1788581173.443540:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581173.445873:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995354624 00000100:00100000:2.0:1788581173.445894:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995354624 00000100:00100000:0.0:1788581173.446054:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 79 00000100:00100000:0.0:1788581173.446069:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:10458:x1875462995354624:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788581173.446264:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:10458:x1875462995354624:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 177us (2723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581173.446287:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 79 00000100:00100000:2.0:1788581173.449734:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581173.449829:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995354752 00000100:00100000:3.0:1788581173.449842:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995354752 00000100:00100000:3.0:1788581173.449917:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:3.0:1788581173.449930:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:10458:x1875462995354752:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581173.449953:0:6723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581173.449976:0:6723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70573 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9106 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.450017:0:6723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a7056c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ff expref: 7 pid: 6722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.450044:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581173.450050:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581173.450056:0:6723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70573 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9106 expref: 7 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.450102:0:6723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a7056c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ff expref: 7 pid: 6722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.450118:0:6723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a7056c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ff expref: 7 pid: 6722 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581173.450135:0:6723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f858e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6723:1875463014255104:192.168.201.13@tcp:104: 00000100:00100000:3.0:1788581173.450310:0:6723:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f8b9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581173.455322:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581173.455487:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995354880 00000100:00100000:2.0:1788581173.455504:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995354880 00010000:00010000:2.0:1788581173.455569:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a7056c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ff expref: 8 pid: 6722 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581173.455638:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:2.0:1788581173.455650:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049af1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2375:x1875462995354880:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581173.455669:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581173.455702:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a7056c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ff expref: 8 pid: 6722 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.455744:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a7056c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ff expref: 8 pid: 6722 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.455774:0:5863:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581173.455780:0:5863:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581173.455789:0:5863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70573 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9106 expref: 8 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.455800:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70573 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9106 expref: 8 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.455849:0:5863:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70573 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9106 expref: 8 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581173.455866:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907611ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5863:1875463014255232:192.168.201.13@tcp:105: 00000100:00100000:2.0:1788581173.455970:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c915480 going to sleep for 11 seconds 00010000:00010000:0.0:1788581173.456706:0:6723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a7056c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ff expref: 8 pid: 6722 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581173.456725:0:6723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f858e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6723:1875463014255104:192.168.201.13@tcp:104: 00010000:00010000:0.0:1788581173.456758:0:6723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70573 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9106 expref: 7 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.456770:0:6723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cec00, rc 0) 00000100:00100000:0.0:1788581173.456827:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:10458:x1875462995354752:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 6899us (7109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581173.456835:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:3.0:1788581173.464583:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907611ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5863:1875463014255232:192.168.201.13@tcp:105: 00010000:00010000:3.0:1788581173.464622:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581173.464727:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049af1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2375:x1875462995354880:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 9077us (9423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581173.464741:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:1.0:1788581173.472954:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581173.473043:0:6730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995355008 00000100:00100000:3.0:1788581173.473057:0:6730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995355008 00002000:00100000:3.0:1788581173.473124:0:6730:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff919075e92a00 x1875462995355008/t0(0) o4->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:529/0 lens 504/0 e 0 to 0 dl 1788581184 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788581173.473137:0:6730:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff919075e92a00 with x1875462995355008 ext(0->8) 00002000:00010000:3.0:1788581173.473164:0:6730:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff919075e92a00 00000100:00100000:3.0:1788581173.473213:0:6730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:3.0:1788581173.473226:0:6730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995355008:12345-192.168.201.13@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788581173.475055:0:6730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2374:x1875462995355008:12345-192.168.201.13@tcp:4:lhsmtool_posix.0 Request processed in 1689us (1974us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788581173.475075:0:6730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00002000:00100000:3.0:1788581173.475092:0:6730:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff919075e92a00 x1875462995355008/t4294967302(0) o4->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:529/0 lens 504/448 e 0 to 0 dl 1788581184 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788581173.475103:0:6730:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff919075e92a00 with x1875462995355008 ext(0->8) 00002000:00010000:3.0:1788581173.475110:0:6730:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff919075e92a00 00000100:00100000:3.0:1788581173.479393:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581173.480441:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995355136 00000100:00100000:2.0:1788581173.480466:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995355136 00000100:00100000:2.0:1788581173.480571:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 80 00000100:00100000:2.0:1788581173.480586:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f85b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:10458:x1875462995355136:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788581173.532943:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f85b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:10458:x1875462995355136:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 Request processed in 52343us (53543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581173.532962:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 80 00000001:00080000:3.0:1788581173.533743:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1788581173.533813:0:5899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:3.0:1788581173.533854:0:5899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788581173.533880:0:5899:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91907f8b9000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788581173.533886:0:5899:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91907fbf6000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91907f8b9f00 00000020:00080000:3.0:1788581173.533889:0:5899:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91907fbf6100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff919076dc3000 00000020:00080000:3.0:1788581173.533914:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788581173.534078:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788581173.534458:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581173.534483:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014255360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788581173.534568:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581173.534886:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788581173.534896:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907611f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014255488:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788581173.534929:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581173.535117:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014255360 00000100:00100000:0.0:1788581173.535128:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014255360 00000100:00100000:3.0:1788581173.535419:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014255488 00000100:00100000:3.0:1788581173.535425:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014255488 00000100:00100000:3.0:1788581173.535508:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788581173.535522:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3341:x1875463014255488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788581173.535561:0:10329:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00000100:00080000:1.0:1788581173.535775:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581173.535817:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788581173.535827:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014255360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788581173.536043:0:6722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788581173.536064:0:6722:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788581173 00002000:00010000:1.0:1788581173.536066:0:6722:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788581173.536069:0:6722:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788581172 -> 1788581173 00002000:00010000:1.0:1788581173.536072:0:6722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:3.0:1788581173.536392:0:10329:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9b9531, atime: 0x6a9b9532, ctime: 0x6a9b9531, blocks: 0xb 00010000:00010000:3.0:1788581173.536414:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a7057a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.536437:0:10329:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=389s v=(0 0) 00010000:00010000:3.0:1788581173.536443:0:10329:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581173.536451:0:10329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a7057a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.536470:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a7057a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.536483:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a7057a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.536493:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a7057a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.536522:0:10329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581173.536750:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581173.536766:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a7057a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.536776:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cfa00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:2.0:1788581173.536782:0:5865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a7057a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.536794:0:5865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a7057a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.536818:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a7057a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.536828:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a7057a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.536855:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581173.536858:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581173.536860:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581173.536937:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014255360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1107us (2364us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788581173.536948:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1788581173.537044:0:3338:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91907fc3dc00/2, rc 0, transno 4294967303 00000100:00100000:1.0:1788581173.537051:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014255360:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788581173.539367:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3341:x1875463014255488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3837us (4425us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788581173.539386:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:0.0:1788581173.541277:0:3341:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91907611f800/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788581173.541294:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907611f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014255488:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788581173.548078:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581173.548420:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995355264 00000100:00100000:3.0:1788581173.548436:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995355264 00000100:00100000:3.0:1788581173.548516:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 30 00000100:00100000:3.0:1788581173.548529:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2372:x1875462995355264:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788581173.579910:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788581173.579935:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1788581173.580097:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2372:x1875462995355264:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 Request processed in 31559us (32025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581173.580134:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 30 00000100:00100000:2.0:1788581173.582408:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581173.582604:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995355520 00000100:00100000:0.0:1788581173.582622:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995355520 00000100:00100000:0.0:1788581173.582719:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 81 00000100:00100000:0.0:1788581173.582729:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:10458:x1875462995355520:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788581173.582798:0:9658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581173.582832:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70565 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90f8 expref: 13 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.582853:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919052341400) 00010000:00010000:0.0:1788581173.582858:0:9658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581173.582898:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70581 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.582912:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70581 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.582921:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70581 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581173.583298:0:9658:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f274aae reply state 000000003ceeba2d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70581 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581173.583309:0:9658:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788581173.583442:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+14:10458:x1875462995355520:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 714us (1045us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788581173.583451:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 81 00010000:00010000:1.0:1788581173.584651:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70581 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.584669:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70581 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.584677:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70581 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.584684:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581173.584689:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70581 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.584699:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70581 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.584719:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919052341400) 00010000:00010000:1.0:1788581173.584722:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581173.584727:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70581 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.584751:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22400/0xf54e3944c2a70581 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581173.585861:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581173.585935:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995355648 00000100:00100000:1.0:1788581173.585946:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995355648 00000100:00100000:1.0:1788581173.586011:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 31 00000100:00100000:1.0:1788581173.586024:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995355648:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788581173.586459:0:6722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788581173.586463:0:6722:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788581173 -> 1788581172 00002000:00010000:1.0:1788581173.586466:0:6722:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788581170 00002000:00010000:1.0:1788581173.586468:0:6722:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788581173 -> 1788581172 00002000:00010000:1.0:1788581173.586471:0:6722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788581173.586557:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2374:x1875462995355648:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 533us (704us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788581173.586566:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 31 00000100:00100000:3.0:1788581173.588107:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581173.588208:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995355904 00000100:00100000:1.0:1788581173.588220:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995355904 00000100:00100000:1.0:1788581173.588406:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 82 00000100:00100000:1.0:1788581173.588421:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:10458:x1875462995355904:12345-192.168.201.13@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788581173.588520:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70588 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.588538:0:5876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70542 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ea expref: 13 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.588547:0:5876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70588 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.588607:0:5876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ea expref: 13 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.588620:0:5876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70542 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ea expref: 13 pid: 5876 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581173.588637:0:5876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075e90380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5876:1875463014255616:192.168.201.13@tcp:104: 00000100:00100000:1.0:1788581173.588735:0:5876:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581173.590905:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581173.590905:0:5876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075e90380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5876:1875463014255616:192.168.201.13@tcp:104: 00010000:00010000:1.0:1788581173.590937:0:5876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70588 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581173.591003:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995356032 00000100:00100000:0.0:1788581173.591016:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995356032 00010000:00010000:0.0:1788581173.591055:0:5862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70542 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ea expref: 14 pid: 5876 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581173.591115:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 43 00000100:00100000:0.0:1788581173.591123:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+14:2374:x1875462995356032:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581173.591136:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581173.591144:0:5862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70542 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ea expref: 14 pid: 5876 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.591158:0:5862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ea expref: 14 pid: 5876 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.591195:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70542 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90ea expref: 14 pid: 5876 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.591223:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919052341400) 00010000:00010000:0.0:1788581173.591229:0:5862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70588 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.591239:0:5862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.591273:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70588 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581173.591305:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581173.591365:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:2374:x1875462995356032:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 241us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581173.591382:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 43 00010000:00010000:1.0:1788581173.591440:0:5876:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.591448:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.591485:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.591493:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70588 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.591500:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70588 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.591507:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581173.591512:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70588 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.591527:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70588 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.591539:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919052341400) 00010000:00010000:1.0:1788581173.591542:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788581173.591547:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70588 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.591553:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70588 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581173.591617:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+12:10458:x1875462995355904:12345-192.168.201.13@tcp:55:lhsmtool_posix.0 Request processed in 3200us (3517us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788581173.591626:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 82 00000100:00100000:2.0:1788581173.596312:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581173.596582:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995356160 00000100:00100000:3.0:1788581173.596659:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995356160 00000100:00100000:3.0:1788581173.596780:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 32 00000100:00100000:3.0:1788581173.596793:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2375:x1875462995356160:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788581173.596853:0:6723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004838b099/0xf54e3944c2a7058f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.596881:0:6723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70573 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9106 expref: 7 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.596891:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581173.596897:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581173.596902:0:6723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004838b099/0xf54e3944c2a7058f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.596947:0:6723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70573 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9106 expref: 7 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.596964:0:6723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70573 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9106 expref: 7 pid: 6723 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581173.596981:0:6723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f859180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6723:1875463014255744:192.168.201.13@tcp:104: 00000100:00100000:3.0:1788581173.597094:0:6723:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f8b99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581173.599638:0:6723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f859180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6723:1875463014255744:192.168.201.13@tcp:104: 00000100:00100000:2.0:1788581173.599646:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00010000:00010000:3.0:1788581173.599676:0:6723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004838b099/0xf54e3944c2a7058f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581173.600338:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995356288 00000100:00100000:3.0:1788581173.600350:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995356288 00010000:00010000:3.0:1788581173.600404:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70573 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9106 expref: 8 pid: 6723 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581173.600456:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:3.0:1788581173.600469:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2374:x1875462995356288:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581173.600490:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581173.600529:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70573 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9106 expref: 8 pid: 6723 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.600547:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70573 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9106 expref: 8 pid: 6723 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.600579:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70573 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9106 expref: 8 pid: 6723 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.600601:0:5861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581173.600606:0:5861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581173.600614:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004838b099/0xf54e3944c2a7058f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.600625:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004838b099/0xf54e3944c2a7058f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.600712:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581173.600883:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2374:x1875462995356288:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 415us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581173.600892:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 44 00010000:00010000:1.0:1788581173.600945:0:6723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004838b099/0xf54e3944c2a7058f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.600956:0:6723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004838b099/0xf54e3944c2a7058f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.600987:0:6723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004838b099/0xf54e3944c2a7058f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.600997:0:6723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004838b099/0xf54e3944c2a7058f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.601006:0:6723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004838b099/0xf54e3944c2a7058f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.601021:0:6723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce400 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581173.601026:0:6723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004838b099/0xf54e3944c2a7058f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.601037:0:6723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004838b099/0xf54e3944c2a7058f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.601054:0:6723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004838b099/0xf54e3944c2a7058f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.601062:0:6723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004838b099/0xf54e3944c2a7058f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581173.601356:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2375:x1875462995356160:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 Request processed in 4563us (5058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581173.601367:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 32 00000100:00100000:2.0:1788581173.606845:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581173.606945:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995356544 00000100:00100000:0.0:1788581173.606961:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995356544 00000100:00100000:0.0:1788581173.607050:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 83 00000100:00100000:0.0:1788581173.607064:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+12:10458:x1875462995356544:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788581173.607556:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70596 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.607584:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.607598:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.607851:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7059d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.607866:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70550 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90f1 expref: 13 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.607874:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7059d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.607913:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70550 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90f1 expref: 13 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581173.607927:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70550 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90f1 expref: 13 pid: 5878 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581173.607942:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075e90380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5877:1875463014255872:192.168.201.13@tcp:104: 00000100:00100000:1.0:1788581173.608044:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581173.611775:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581173.611847:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075e90380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5877:1875463014255872:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581173.611882:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7059d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581173.611976:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995356672 00000100:00100000:3.0:1788581173.611985:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995356672 00010000:00010000:3.0:1788581173.612034:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70550 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90f1 expref: 14 pid: 5878 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581173.612077:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:3.0:1788581173.612088:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+14:2375:x1875462995356672:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581173.612108:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581173.612117:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70550 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90f1 expref: 14 pid: 5878 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.612131:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70550 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90f1 expref: 14 pid: 5878 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.612161:0:6739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70550 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90f1 expref: 14 pid: 5878 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.612202:0:6739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919052341400) 00010000:00010000:3.0:1788581173.612208:0:6739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7059d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.612220:0:6739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7059d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.612228:0:6739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7059d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.612274:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581173.612353:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:2375:x1875462995356672:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 262us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581173.612361:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 45 00010000:00010000:3.0:1788581173.612393:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7059d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.612400:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7059d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788581173.612667:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788581173.612843:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788581173.612896:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788581173.612996:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f859880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5877:1875463014256000:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788581173.613078:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581173.613120:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f8b96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581173.613154:0:5882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014256000 00000100:00100000:3.0:1788581173.613160:0:5882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014256000 00000100:00100000:3.0:1788581173.613214:0:5882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788581173.613231:0:5882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f85ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5877:x1875463014256000:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788581173.613340:0:5882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f85ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5877:x1875463014256000:12345-0@lo:1000:mdt00_001.0 Request processed in 111us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581173.613348:0:5882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788581173.613478:0:5877:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788581173.613485:0:5877:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91907fc3dc00, transno 4294967303 00000100:00100000:3.0:1788581173.613500:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f859880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5877:1875463014256000:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788581173.614007:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788581173.614074:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f859880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5877:1875463014256128:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788581173.614122:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581173.614142:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f8b99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581173.616306:0:5882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014256128 00000100:00100000:2.0:1788581173.616326:0:5882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014256128 00000100:00100000:2.0:1788581173.616413:0:5882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581173.616426:0:5882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5877:x1875463014256128:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788581173.616839:0:5882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5877:x1875463014256128:12345-0@lo:1000:mdt00_001.0 Request processed in 416us (2716us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788581173.616847:0:5882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788581173.617282:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f859880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5877:1875463014256128:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788581173.617341:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7059d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617354:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7059d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617364:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7059d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617370:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581173.617376:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7059d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617385:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7059d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617407:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919052341400) 00010000:00010000:3.0:1788581173.617417:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581173.617423:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7059d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617430:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7059d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617473:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a704cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617479:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a704cb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617486:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a704cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617491:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413ff200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581173.617494:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a704cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617500:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a704cb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617508:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341500) 00010000:00010000:3.0:1788581173.617510:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581173.617513:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a704cb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617518:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a704cb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617543:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a705a4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617574:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a704e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90d5 expref: 16 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617585:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a705a4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617701:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a704e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90d5 expref: 16 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.617719:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a704e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90d5 expref: 16 pid: 5878 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581173.617736:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f859f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5877:1875463014256256:192.168.201.13@tcp:104: 00000100:00100000:3.0:1788581173.617829:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff919042bdc540 going to sleep for 11 seconds 00000100:00100000:3.0:1788581173.620783:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581173.621695:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995356800 00000100:00100000:3.0:1788581173.621712:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995356800 00010000:00010000:3.0:1788581173.621777:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a704e7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90d5 expref: 17 pid: 5878 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581173.622103:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:2.0:1788581173.622119:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+17:2374:x1875462995356800:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581173.622137:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581173.622218:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a704e7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90d5 expref: 17 pid: 5878 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.622235:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a704e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90d5 expref: 17 pid: 5878 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.622293:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341500) 00010000:00010000:2.0:1788581173.622299:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a705a4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.622312:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a705a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.622321:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a705a4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.622343:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581173.622418:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+17:2374:x1875462995356800:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 303us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581173.622426:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 46 00010000:00010000:2.0:1788581173.623350:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190414b2800/0xf54e3944c2a704e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d90d5 expref: 16 pid: 5878 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581173.623374:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f859f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5877:1875463014256256:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581173.623403:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a705a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.623414:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a705a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.623420:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a705a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.627584:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a705a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.627619:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a705a4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.627628:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a705a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.627635:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cec00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581173.627640:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a705a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.627650:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a705a4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.627674:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341500) 00010000:00010000:2.0:1788581173.627677:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581173.627707:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a705a4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.627714:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a705a4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.627747:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.627753:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70596 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.627759:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70596 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.627765:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581173.627768:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70596 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.627775:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70596 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.627783:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341500) 00010000:00010000:2.0:1788581173.627786:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788581173.627789:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70596 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.627795:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70596 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581173.628150:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+15:10458:x1875462995356544:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 21071us (21298us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788581173.628162:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 83 00000020:00080000:2.0:1788581173.628177:0:5877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788581173.631851:0:11735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788581173.631866:0:11735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788581173.631907:0:11735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788581173.631914:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788581173.635880:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581173.636019:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995357056 00000100:00100000:2.0:1788581173.636035:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995357056 00000100:00100000:2.0:1788581173.636116:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:2.0:1788581173.636129:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+15:10458:x1875462995357056:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788581173.637307:0:5879:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788581173.637430:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1788581173.637486:0:5879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a705ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.637509:0:5879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a705ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.637524:0:5879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a705ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.637535:0:5879:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a705ab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.637542:0:5879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a705ab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.637549:0:5879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a705ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581173.637574:0:5879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788581173.637728:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+17:10458:x1875462995357056:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 1597us (1867us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788581173.637739:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 20 00000020:00080000:2.0:1788581173.637745:0:5879:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788581173.639343:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581173.639362:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a705ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.639403:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb82e00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581173.639409:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a705ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.639419:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a705ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.639451:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91905c525e00) 00010000:00010000:3.0:1788581173.639455:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788581173.639461:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a705ab lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.639467:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a705ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581173.639493:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581173.639495:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581173.639497:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581174.031921:0:12052:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788581174.031939:0:12052:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788581174.031985:0:12052:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788581174.031991:0:12052:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788581174.157386:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581174.157483:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995357312 00000100:00100000:3.0:1788581174.157509:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995357312 00000100:00080000:1.0:1788581174.157577:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581174.157627:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 84 00000100:00100000:3.0:1788581174.157652:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+17:10477:x1875462995357312:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581174.157693:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581174.157725:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d910d expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.157893:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce800/0xf54e3944c2a705b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.157912:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce800/0xf54e3944c2a705b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.157941:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce800/0xf54e3944c2a705b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581174.157958:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788581174.158137:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d910d expref: 20 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.158167:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce800/0xf54e3944c2a705b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d910d expref: 19 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.158187:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:3.0:1788581174.158191:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788581174.158195:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce800, rc 0) 00000100:00100000:3.0:1788581174.158324:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:10477:x1875462995357312:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 685us (955us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788581174.158333:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 84 00000100:00100000:1.0:1788581174.172148:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581174.177373:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995357440 00000100:00100000:3.0:1788581174.177392:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995357440 00000100:00100000:3.0:1788581174.177801:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 85 00000100:00100000:3.0:1788581174.177841:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:10477:x1875462995357440:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:3.0:1788581174.177958:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.177980:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.177994:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.178027:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.178035:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.178041:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.178416:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a705d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.178425:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a705d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.178445:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a705d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581174.178510:0:9658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a705d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.178528:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.178536:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.178544:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.178551:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581174.178557:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.178573:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.178591:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:3.0:1788581174.178594:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581174.178599:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.178605:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.178617:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.178624:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.178629:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.178634:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cee00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581174.178636:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.180720:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.180751:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff919052341400) 00010000:00010000:3.0:1788581174.180756:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581174.180762:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.180783:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.180818:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a705d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.180825:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a705d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.180832:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a705d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.180838:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581174.180842:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a705d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.180847:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a705d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.180855:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341600) 00010000:00010000:3.0:1788581174.180857:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581174.180859:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a705d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.180865:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a705d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581174.181855:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:10477:x1875462995357440:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 4025us (9709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581174.181872:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 85 00000100:00100000:1.0:1788581174.230965:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581174.231299:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995357696 00000100:00100000:3.0:1788581174.231314:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995357696 00000100:00100000:3.0:1788581174.231410:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 86 00000100:00100000:3.0:1788581174.231424:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:10481:x1875462995357696:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581174.231459:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581174.231496:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a705dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9114 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.231616:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.231636:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.231651:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.231670:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.231678:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.231685:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.232748:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a705f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.232766:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a705f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.232791:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a705f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581174.232805:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788581174.234427:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.234447:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.234455:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.234462:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cee00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581174.234467:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.234476:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.234495:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:3.0:1788581174.234499:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581174.234505:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.234511:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a705e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.234528:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.234535:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.234560:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.234566:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581174.234569:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.234575:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.234583:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff919052341600) 00010000:00010000:3.0:1788581174.234586:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581174.234589:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.234595:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a705ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.234667:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a705dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9114 expref: 22 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.234686:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a705f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9114 expref: 21 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.234693:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341400) 00010000:00010000:3.0:1788581174.234695:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581174.234698:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf400, rc 0) 00000100:00100000:3.0:1788581174.234792:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+21:10481:x1875462995357696:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 3370us (3853us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788581174.234812:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 86 00000100:00100000:1.0:1788581174.242204:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581174.242561:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995357824 00000100:00100000:2.0:1788581174.242581:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995357824 00000100:00100000:2.0:1788581174.242684:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 87 00000100:00100000:2.0:1788581174.242700:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+21:10481:x1875462995357824:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:2.0:1788581174.242814:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a705ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.242837:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a705ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.242853:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a705ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.242893:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a705ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.242902:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a705ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.242911:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a705ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.242919:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581174.242926:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a705ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.242936:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a705ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.242964:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341400) 00010000:00010000:2.0:1788581174.242968:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788581174.242984:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a705ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.242991:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a705ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581174.243107:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+21:10481:x1875462995357824:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 410us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581174.243115:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 87 00000100:00100000:1.0:1788581174.259017:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581174.259189:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995358080 00000100:00100000:0.0:1788581174.259202:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995358080 00000100:00100000:0.0:1788581174.259293:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:0.0:1788581174.259306:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190673cd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+21:10481:x1875462995358080:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:0.0:1788581174.267286:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190673cd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+22:10481:x1875462995358080:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 7938us (8241us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788581174.267311:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 21 00010000:00010000:3.0:1788581174.319928:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581174.327105:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581174.327164:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995358336 00000100:00100000:3.0:1788581174.327190:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995358336 00000100:00100000:3.0:1788581174.327294:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 88 00000100:00100000:3.0:1788581174.327307:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+22:10007:x1875462995358336:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1788581174.327338:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581174.327367:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70606 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d911b expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.327504:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7060d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.327522:0:5878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a705f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9114 expref: 23 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.327532:0:5878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7060d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.327596:0:5878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a705f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9114 expref: 23 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.327612:0:5878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a705f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9114 expref: 23 pid: 5876 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581174.327630:0:5878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5878:1875463014256384:192.168.201.13@tcp:104: 00000100:00100000:3.0:1788581174.346528:0:5878:0:(client.c:2715:ptlrpc_set_wait()) set ffff919072187480 going to sleep for 11 seconds 00000100:00100000:0.0:1788581174.348258:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581174.349394:0:5878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5878:1875463014256384:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581174.349436:0:5878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7060d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581174.349472:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995358464 00000100:00100000:3.0:1788581174.349482:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995358464 00010000:00010000:3.0:1788581174.349533:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a705f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9114 expref: 24 pid: 5876 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581174.350001:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 47 00000100:00100000:0.0:1788581174.350016:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+24:2374:x1875462995358464:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581174.350035:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581174.350044:0:5862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a705f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9114 expref: 24 pid: 5876 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.350059:0:5862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a705f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9114 expref: 24 pid: 5876 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.350108:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a705f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9114 expref: 24 pid: 5876 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.350125:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341400) 00010000:00010000:0.0:1788581174.350130:0:5862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7060d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.350141:0:5862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7060d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.350148:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7060d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.350179:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581174.350282:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+23:2374:x1875462995358464:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 269us (2048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581174.350291:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 47 00010000:00010000:2.0:1788581174.352079:0:5878:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7060d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.352099:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7060d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581174.352128:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788581174.353061:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70606 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d911b expref: 24 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.353090:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7060d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d911b expref: 23 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.353101:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341400) 00010000:00010000:2.0:1788581174.353105:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788581174.353109:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf200, rc 0) 00000100:00100000:2.0:1788581174.354534:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+23:10007:x1875462995358336:12345-192.168.201.13@tcp:101:bash.0 Request processed in 27215us (27432us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788581174.354547:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 88 00000100:00100000:3.0:1788581174.362139:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581174.362310:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995358720 00000100:00100000:2.0:1788581174.362326:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995358720 00000100:00100000:2.0:1788581174.362425:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 89 00000100:00100000:2.0:1788581174.362438:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+23:10007:x1875462995358720:12345-192.168.201.13@tcp:36:bash.0 00010000:00010000:2.0:1788581174.363919:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7061b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.363946:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7061b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.363960:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7061b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581174.364676:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1788581174.364719:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063b62010 reply state 00000000b6660dbb transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7061b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581174.365077:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788581174.365167:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1788581174.365386:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+27:10007:x1875462995358720:12345-192.168.201.13@tcp:36:bash.0 Request processed in 2944us (3257us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788581174.365396:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 89 00000020:00080000:2.0:1788581174.365403:0:5877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788581174.369110:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7061b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.369135:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7061b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.369144:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7061b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.369150:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581174.369185:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7061b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.369194:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7061b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.369217:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341400) 00010000:00010000:1.0:1788581174.369221:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581174.369225:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7061b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.369232:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7061b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581174.369333:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581174.369409:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995358848 00000100:00100000:1.0:1788581174.369421:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995358848 00000100:00100000:1.0:1788581174.369489:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 90 00000100:00100000:1.0:1788581174.369501:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+26:10007:x1875462995358848:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:1.0:1788581174.369533:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581174.369558:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a70622 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9122 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.369833:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a70622 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9122 expref: 27 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.369850:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a70622 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9122 expref: 27 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.369872:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341400) 00010000:00010000:1.0:1788581174.369875:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788581174.369887:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9000, rc 0) 00000100:00100000:1.0:1788581174.369965:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+27:10007:x1875462995358848:12345-192.168.201.13@tcp:101:bash.0 Request processed in 465us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581174.370043:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 90 00000100:00100000:0.0:1788581174.375194:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581174.375258:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995358976 00000100:00100000:0.0:1788581174.375272:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995358976 00000100:00100000:0.0:1788581174.375346:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:0.0:1788581174.375359:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904a0f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:10007:x1875462995358976:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:0.0:1788581174.375385:0:6722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581174.375414:0:6722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a70629 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9129 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788581174.375469:0:6722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9b9534, atime: 0x6a9b9532, ctime: 0x6a9b9534, blocks: 0xb 00010000:00010000:0.0:1788581174.375502:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1788581174.375507:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581174.375517:0:6722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a70629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9129 expref: 7 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.375538:0:6722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a70629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9129 expref: 7 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.375555:0:6722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc23800, rc 0) 00000100:00100000:0.0:1788581174.377234:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904a0f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:10007:x1875462995358976:12345-192.168.201.13@tcp:101:bash.0 Request processed in 1864us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581174.377262:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:0.0:1788581174.386068:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581174.386189:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995359104 00000100:00100000:1.0:1788581174.386204:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995359104 00002000:00010000:1.0:1788581174.386351:0:6728:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788581174.386357:0:6728:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91907611f100 with x1875462995359104 ext(0->18446744073709551615) 00002000:00010000:1.0:1788581174.386373:0:6728:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91907611f100. 00000100:00100000:1.0:1788581174.386412:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:1.0:1788581174.386425:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2375:x1875462995359104:12345-192.168.201.13@tcp:10:bash.0 00002000:00010000:1.0:1788581174.387140:0:6728:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788581174.387146:0:6728:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788581172 -> 1788581173 00002000:00010000:1.0:1788581174.387150:0:6728:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788581170 -> 1788581170 00002000:00010000:1.0:1788581174.387152:0:6728:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788581172 -> 1788581173 00002000:00010000:1.0:1788581174.387155:0:6728:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788581174.387318:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2375:x1875462995359104:12345-192.168.201.13@tcp:10:bash.0 Request processed in 894us (1264us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788581174.387328:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 1 00002000:00010000:1.0:1788581174.387333:0:6728:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788581174.387337:0:6728:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91907611f100 with x1875462995359104 ext(0->18446744073709551615) 00002000:00010000:1.0:1788581174.387344:0:6728:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91907611f100. 00000100:00100000:2.0:1788581174.489162:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581174.489350:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995359232 00000100:00100000:1.0:1788581174.489365:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995359232 00000100:00100000:1.0:1788581174.489444:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 91 00000100:00100000:1.0:1788581174.489457:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+27:10495:x1875462995359232:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:1.0:1788581174.489588:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70630 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.489612:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70630 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.489629:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70630 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.489649:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70637 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.489658:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70637 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.489666:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70637 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490115:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a7063e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490127:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a7063e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490135:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a7063e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788581174.490206:0:9658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a7063e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490221:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70630 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490239:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70630 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490313:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70630 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490320:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581174.490325:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70630 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490334:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70630 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490350:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:1.0:1788581174.490354:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581174.490360:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70630 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490367:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70630 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490385:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70637 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490392:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70637 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490399:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70637 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490405:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581174.490414:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70637 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490421:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70637 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490430:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91905c6f1600) 00010000:00010000:1.0:1788581174.490433:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581174.490436:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70637 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490442:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70637 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490463:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a7063e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490470:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a7063e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490476:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a7063e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490482:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9a00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581174.490485:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a7063e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490491:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a7063e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490498:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341400) 00010000:00010000:1.0:1788581174.490500:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581174.490509:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a7063e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.490516:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a7063e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581174.490626:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+27:10495:x1875462995359232:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 1168us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581174.490635:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 91 00000100:00100000:0.0:1788581174.553373:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581174.559047:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995359488 00000100:00100000:2.0:1788581174.559068:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995359488 00000100:00100000:2.0:1788581174.560961:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 92 00000100:00100000:2.0:1788581174.560987:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+27:10498:x1875462995359488:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1788581174.561017:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581174.561055:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70645 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9130 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561212:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7064c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561232:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7064c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561267:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7064c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561286:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70653 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561295:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561303:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561637:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a7065a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561648:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a7065a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561656:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a7065a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581174.561669:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788581174.561778:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7064c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561786:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7064c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561799:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7064c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561806:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb82a00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581174.561812:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7064c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561820:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7064c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561834:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:2.0:1788581174.561837:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581174.561842:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7064c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561850:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7064c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561867:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561873:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70653 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561879:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70653 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561885:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581174.561889:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70653 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561905:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70653 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561914:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91905c525500) 00010000:00010000:2.0:1788581174.561916:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581174.561919:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70653 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561926:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70653 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561973:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70645 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9130 expref: 30 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561988:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a7065a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9130 expref: 29 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.561996:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341400) 00010000:00010000:2.0:1788581174.561999:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788581174.562001:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb83800, rc 0) 00000100:00100000:2.0:1788581174.562112:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+29:10498:x1875462995359488:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1135us (8753us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788581174.562122:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 92 00000100:00100000:0.0:1788581174.566357:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581174.567064:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995359616 00000100:00100000:1.0:1788581174.567084:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995359616 00000100:00100000:1.0:1788581174.567184:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 93 00000100:00100000:1.0:1788581174.567199:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+29:10498:x1875462995359616:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:1.0:1788581174.567327:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70668 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.567351:0:9658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7060d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d911b expref: 29 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.567363:0:9658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70668 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.567417:0:9658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7060d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d911b expref: 29 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.567433:0:9658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7060d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d911b expref: 29 pid: 5878 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581174.567454:0:9658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9658:1875463014256512:192.168.201.13@tcp:104: 00000100:00100000:1.0:1788581174.568208:0:9658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581174.571789:0:9658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9658:1875463014256512:192.168.201.13@tcp:104: 00010000:00010000:1.0:1788581174.571844:0:9658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70668 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581174.575533:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581174.575961:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995359872 00000100:00100000:2.0:1788581174.575978:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995359872 00000100:00100000:2.0:1788581174.576073:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:2.0:1788581174.576090:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+30:5610:x1875462995359872:12345-192.168.201.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788581174.576691:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+31:5610:x1875462995359872:12345-192.168.201.13@tcp:35:ldlm_bl.0 Request processed in 601us (1173us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788581174.576700:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:0.0:1788581174.582163:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581174.582322:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995360000 00000100:00100000:2.0:1788581174.582339:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995360000 00010000:00010000:2.0:1788581174.582409:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7060d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d911b expref: 31 pid: 5878 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581174.582512:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:2.0:1788581174.582525:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+31:2375:x1875462995360000:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581174.582547:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581174.582557:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7060d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d911b expref: 31 pid: 5878 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.582575:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7060d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d911b expref: 31 pid: 5878 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.582605:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a7060d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d911b expref: 31 pid: 5878 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.582630:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341400) 00010000:00010000:2.0:1788581174.582638:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70668 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.582651:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.582661:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70668 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.582722:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581174.582794:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+30:2375:x1875462995360000:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 270us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581174.582802:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 48 00010000:00010000:1.0:1788581174.583845:0:9658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.583862:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.583913:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.583921:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70668 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.583929:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.583947:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9a00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581174.583953:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.583963:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70668 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.583983:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341400) 00010000:00010000:1.0:1788581174.583987:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581174.583992:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70668 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.584022:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70668 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581174.584239:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+29:10498:x1875462995359616:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 17039us (17892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581174.584306:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 93 00000100:00100000:0.0:1788581174.588969:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581174.591129:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995360256 00000100:00100000:3.0:1788581174.591159:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995360256 00000100:00100000:3.0:1788581174.591340:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00100000:3.0:1788581174.591359:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+29:10498:x1875462995360256:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:3.0:1788581174.593596:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+30:10498:x1875462995360256:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 1877us (4291us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788581174.593617:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00100000:0.0:1788581174.731590:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581174.732530:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995360512 00000100:00100000:1.0:1788581174.732548:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995360512 00000100:00100000:1.0:1788581174.732751:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 94 00000100:00100000:1.0:1788581174.732764:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+30:10509:x1875462995360512:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:1.0:1788581174.732800:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581174.732840:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a7066f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9137 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.732943:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70676 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.732962:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70676 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.732977:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70676 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.732994:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a7067d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.733002:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a7067d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.733041:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a7067d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.733565:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.733576:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.733585:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581174.733596:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788581174.735546:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70676 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.735567:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70676 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.735576:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70676 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.735584:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581174.735589:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70676 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.735598:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70676 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.735618:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:1.0:1788581174.735622:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581174.737350:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70676 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.737371:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70676 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.737398:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a7067d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.737405:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a7067d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.737411:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a7067d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.737417:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581174.737427:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a7067d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.737435:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a7067d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.737452:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91905c6f1600) 00010000:00010000:1.0:1788581174.737455:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581174.737458:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a7067d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.737464:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a7067d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.737554:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a7066f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9137 expref: 33 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.737592:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9137 expref: 32 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.737601:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341400) 00010000:00010000:1.0:1788581174.737604:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581174.737607:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9c00, rc 0) 00000100:00100000:1.0:1788581174.739396:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+32:10509:x1875462995360512:12345-192.168.201.13@tcp:101:cat.0 Request processed in 6615us (7806us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788581174.739413:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 94 00000100:00100000:0.0:1788581174.747835:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581174.748048:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995360768 00000100:00100000:3.0:1788581174.748063:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995360768 00000100:00100000:3.0:1788581174.748143:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 24 00000100:00100000:3.0:1788581174.748158:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+32:10509:x1875462995360768:12345-192.168.201.13@tcp:35:cat.0 00000100:00100000:3.0:1788581174.748769:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+33:10509:x1875462995360768:12345-192.168.201.13@tcp:35:cat.0 Request processed in 612us (961us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788581174.748779:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 24 00000100:00100000:0.0:1788581174.780707:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581174.780868:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995361024 00000100:00100000:2.0:1788581174.780882:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995361024 00000100:00100000:2.0:1788581174.781423:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 95 00000100:00100000:2.0:1788581174.781441:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+33:10510:x1875462995361024:12345-192.168.201.13@tcp:36:rm.0 00010000:00010000:2.0:1788581174.781534:0:5878:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788581174.781586:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70684 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9137 expref: 33 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.781618:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a7065a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9130 expref: 32 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.781635:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a70622 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9122 expref: 31 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.781647:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919052341400) 00010000:00010000:2.0:1788581174.781660:0:5878:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581174.781689:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70692 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.781706:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70692 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.781717:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70692 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.781754:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70699 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.781762:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70699 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.781770:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70699 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.782455:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a706a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.782469:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a706a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.782476:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a706a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788581174.785876:0:5878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1788581174.785897:0:5878:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 391026652975ns, next at 392026648005ns, rc = 0 00010000:00010000:2.0:1788581174.786748:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a706a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.786773:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a706a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.786787:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a706a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.786797:0:5878:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a706a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.786823:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a706a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.786831:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a706a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.786861:0:5878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581174.786891:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a706a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.786899:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a706a0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.786915:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581174.786926:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a706a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.787288:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a706a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.787310:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83200 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581174.787319:0:5865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a706a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.787332:0:5865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a706a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.787350:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905c525d00) 00010000:00010000:0.0:1788581174.787354:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788581174.787360:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a706a7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.787366:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a706a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.787386:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581174.787388:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581174.787390:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581174.787639:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb82a00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581174.787646:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a706a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.787654:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a706a0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.787664:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905c525d00) 00010000:00010000:2.0:1788581174.787667:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788581174.787671:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a706a0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.787677:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a706a0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.787703:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70692 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.787717:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70692 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.787724:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70692 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.787728:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581174.787731:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70692 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.787737:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70692 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.787744:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:2.0:1788581174.787746:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581174.787749:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70692 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.787756:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70692 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581174.787765:0:5878:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a48666de reply state 000000006c562f9d transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70699 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581174.787775:0:5878:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788581174.787898:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+32:10510:x1875462995361024:12345-192.168.201.13@tcp:36:rm.0 Request processed in 6458us (7199us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788581174.787918:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 95 00010000:00010000:0.0:1788581174.797021:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70699 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.797047:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70699 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.797057:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70699 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.797063:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581174.797068:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70699 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.797392:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70699 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.797417:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91905c525500) 00010000:00010000:0.0:1788581174.797421:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581174.797427:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70699 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.797434:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70699 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581174.853006:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581174.854408:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995361280 00000100:00100000:3.0:1788581174.854459:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995361280 00000100:00100000:3.0:1788581174.855949:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 96 00000100:00100000:3.0:1788581174.855975:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+31:10516:x1875462995361280:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1788581174.856016:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581174.856051:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a706ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d913e expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.856320:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a706b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.856343:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a706b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.856359:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a706b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.856381:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a706bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.856388:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a706bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.856396:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a706bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788581174.857193:0:5877:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788581174.857463:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a706c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.857479:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a706c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.857501:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a706c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.857551:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a706b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.857560:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a706b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.857567:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a706b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.857573:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cee00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581174.857578:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a706b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.857586:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a706b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.857601:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:3.0:1788581174.857604:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581174.857610:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a706b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.857615:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a706b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581174.857632:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4beb08d reply state 00000000544c4021 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a706bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581174.857643:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788581174.857690:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a706ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d913e expref: 34 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.857707:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a706c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d913e expref: 33 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581174.857715:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341e00) 00010000:00010000:3.0:1788581174.857717:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581174.857719:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf800, rc 0) 00000100:00100000:3.0:1788581174.857843:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+34:10516:x1875462995361280:12345-192.168.201.13@tcp:101:bash.0 Request processed in 1878us (4852us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788581174.867419:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581174.867465:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995361408 00000100:00100000:0.0:1788581174.867479:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995361408 00000100:00100000:0.0:1788581174.867562:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00100000:0.0:1788581174.867576:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2375:x1875462995361408:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:0.0:1788581174.867617:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581174.867657:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a706d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9145 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788581174.867695:0:6725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581174.867721:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=391s v=(0 0) 00010000:00010000:0.0:1788581174.867727:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581174.867738:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a706d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9145 expref: 6 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.867761:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a706d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9145 expref: 6 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.867811:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22600, rc 0) 00000100:00100000:0.0:1788581174.867881:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2375:x1875462995361408:12345-192.168.201.13@tcp:101:bash.0 Request processed in 308us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581174.867889:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00080000:0.0:1788581174.867917:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788581174.872885:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a706bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.872934:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a706bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.872941:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a706bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.872945:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581174.872951:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a706bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.872958:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a706bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.872978:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff919052341600) 00010000:00010000:2.0:1788581174.872980:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581174.872985:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a706bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.872991:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a706bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581174.874304:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 96 00000100:00100000:0.0:1788581174.892800:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581174.892929:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995361536 00000100:00100000:1.0:1788581174.892942:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995361536 00000100:00100000:1.0:1788581174.893013:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 35 00000100:00100000:1.0:1788581174.893025:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:10516:x1875462995361536:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:1.0:1788581174.893048:0:6722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581174.893072:0:6722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b84d77e7/0xf54e3944c2a706d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d914c expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.893112:0:6722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a706d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9145 expref: 7 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.893122:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581174.893128:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581174.893135:0:6722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b84d77e7/0xf54e3944c2a706d8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d914c expref: 7 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.893213:0:6722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a706d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9145 expref: 7 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581174.893229:0:6722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a706d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9145 expref: 7 pid: 6725 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581174.893301:0:6722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f8b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6722:1875463014256640:192.168.201.13@tcp:104: 00000100:00100000:1.0:1788581174.893423:0:6722:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581174.898017:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3338:1875463014256896:0@lo:400:kworker.0 00000100:00100000:1.0:1788581174.898137:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581174.898219:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014257408:0@lo:400:kworker.0 00000100:00100000:1.0:1788581174.898288:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581174.898321:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581174.898327:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014257024:0@lo:400:kworker.0 00000100:00100000:1.0:1788581174.898352:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581174.898392:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014256896 00000100:00100000:1.0:1788581174.898403:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014256896 00000100:00100000:1.0:1788581174.898464:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014257024 00000100:00100000:1.0:1788581174.898467:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014257024 00000100:00100000:1.0:1788581174.898515:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788581174.898526:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3338:x1875463014256896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581174.898592:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3338:x1875463014256896:12345-0@lo:400:kworker.0 Request processed in 67us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581174.898600:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788581174.898755:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788581174.898761:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014257024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581174.898790:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014257024:12345-0@lo:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581174.898796:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788581174.898838:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014257024:0@lo:400:kworker.0 00000100:00100000:1.0:1788581174.898849:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3338:1875463014256896:0@lo:400:kworker.0 00000100:00100000:2.0:1788581174.899058:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f8b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014256768:0@lo:400:kworker.0 00000100:00080000:0.0:1788581174.899069:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581174.899087:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014257408 00000100:00100000:0.0:1788581174.899091:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014257408 00000100:00100000:2.0:1788581174.899099:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581174.899135:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788581174.899141:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3341:1875463014257280:0@lo:400:kworker.0 00000100:00100000:0.0:1788581174.899143:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3338:x1875463014257408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581174.899177:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581174.899277:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014257152:0@lo:400:kworker.0 00000100:00100000:1.0:1788581174.899445:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014257280 00000100:00100000:1.0:1788581174.899450:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014257280 00000100:00100000:1.0:1788581174.899494:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788581174.899501:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3341:x1875463014257280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581174.905315:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014256768 00000100:00100000:2.0:1788581174.905341:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014256768 00000100:00100000:2.0:1788581174.905863:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788581174.905879:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014256768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581174.906010:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014256768:12345-0@lo:400:kworker.0 Request processed in 136us (6909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581174.906019:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788581174.906089:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f8b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014256768:0@lo:400:kworker.0 00000100:00100000:2.0:1788581174.906305:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014257408:0@lo:400:kworker.0 00000100:00080000:2.0:1788581174.908309:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581174.908411:0:6722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f8b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6722:1875463014256640:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581174.908552:0:6722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b84d77e7/0xf54e3944c2a706d8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d914c expref: 7 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581174.908587:0:6722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9a00, rc 0) 00000100:00100000:0.0:1788581174.909549:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3338:x1875463014257408:12345-0@lo:400:kworker.0 Request processed in 10395us (11248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581174.909567:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788581174.909688:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:10516:x1875462995361536:12345-192.168.201.13@tcp:101:bash.0 Request processed in 16663us (16903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581174.909696:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 35 00000100:00100000:2.0:1788581174.913129:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581174.913216:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581174.913393:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995361664 00000100:00100000:0.0:1788581174.913407:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995361664 00010000:00010000:0.0:1788581174.913465:0:5862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a706d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9145 expref: 7 pid: 6725 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581174.913472:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3341:x1875463014257280:12345-0@lo:400:kworker.0 Request processed in 13969us (14291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581174.913514:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:0.0:1788581174.913527:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2375:x1875462995361664:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581174.913550:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788581174.913556:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00010000:00010000:0.0:1788581174.913655:0:5862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a706d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9145 expref: 7 pid: 6725 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.913700:0:5862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a706d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9145 expref: 7 pid: 6725 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.913731:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a706d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9145 expref: 7 pid: 6725 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.913750:0:5862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581174.913756:0:5862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581174.913766:0:5862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b84d77e7/0xf54e3944c2a706d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d914c expref: 6 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581174.913778:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b84d77e7/0xf54e3944c2a706d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d914c expref: 6 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581174.913806:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014257152 00000100:00100000:3.0:1788581174.913810:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014257152 00010000:00010000:0.0:1788581174.913825:0:5862:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b84d77e7/0xf54e3944c2a706d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d914c expref: 6 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581174.913843:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484fca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5862:1875463014257536:192.168.201.13@tcp:105: 00000100:00100000:3.0:1788581174.913864:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788581174.913871:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3340:x1875463014257152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581174.913926:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3340:x1875463014257152:12345-0@lo:400:kworker.0 Request processed in 55us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581174.913932:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788581174.913935:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set ffff91905bdca780 going to sleep for 11 seconds 00000100:00100000:3.0:1788581174.913983:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014257152:0@lo:400:kworker.0 00000100:00100000:2.0:1788581174.914086:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3341:1875463014257280:0@lo:400:kworker.0 00000100:00080000:1.0:1788581174.914145:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581174.924787:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484fca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5862:1875463014257536:192.168.201.13@tcp:105: 00010000:00010000:3.0:1788581174.924826:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581174.924945:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2375:x1875462995361664:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 11419us (11833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581174.924959:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:0.0:1788581174.945876:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581174.950529:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995361920 00000100:00100000:3.0:1788581174.950558:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995361920 00000100:00100000:2.0:1788581174.951865:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 25 00000100:00100000:2.0:1788581174.951884:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+33:10516:x1875462995361920:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:2.0:1788581174.952462:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+34:10516:x1875462995361920:12345-192.168.201.13@tcp:35:bash.0 Request processed in 578us (7472us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788581174.952473:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 25 00000100:00100000:0.0:1788581175.172942:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581175.172996:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581175.173099:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995362048 00000100:00100000:3.0:1788581175.173113:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995362048 00000100:00100000:3.0:1788581175.173194:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 293 00000100:00100000:3.0:1788581175.173211:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2372:x1875462995362048:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581175.173351:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2372:x1875462995362048:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 148us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581175.173360:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 293 00000100:00100000:0.0:1788581175.173781:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581175.175449:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995362176 00000100:00100000:3.0:1788581175.175467:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995362176 00000100:00100000:3.0:1788581175.175585:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 79 00000100:00080000:0.0:1788581175.175585:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581175.175598:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2372:x1875462995362176:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581175.175726:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2372:x1875462995362176:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 132us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581175.175735:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 79 00000100:00100000:2.0:1788581175.178738:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995362304 00000100:00100000:2.0:1788581175.179291:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995362304 00000100:00100000:2.0:1788581175.179501:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 147 00000100:00100000:2.0:1788581175.179518:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2372:x1875462995362304:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581175.179675:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2372:x1875462995362304:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 160us (6676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581175.179684:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 147 00000100:00080000:0.0:1788581175.189797:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581175.240837:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581175.241096:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995362432 00000100:00100000:2.0:1788581175.241349:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995362432 00000100:00100000:2.0:1788581175.241451:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 97 00000100:00100000:2.0:1788581175.241465:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+34:10532:x1875462995362432:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1788581175.241862:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581175.241894:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a706df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9153 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.242725:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a706e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.242748:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a706e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.242764:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a706e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581175.242825:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788581175.242830:0:5876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788581175.242853:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a706e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.242888:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a706df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9153 expref: 36 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.242936:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a706e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9153 expref: 35 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.242947:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:2.0:1788581175.242950:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788581175.242954:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb83800, rc 0) 00000100:00100000:2.0:1788581175.243053:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+35:10532:x1875462995362432:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1589us (2230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581175.243063:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 97 00000100:00100000:1.0:1788581175.258378:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581175.258882:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995362688 00000100:00100000:2.0:1788581175.258898:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995362688 00000100:00100000:2.0:1788581175.258981:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 98 00000100:00100000:2.0:1788581175.258994:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+35:10532:x1875462995362688:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1788581175.259023:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581175.259053:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a706ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d915a expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.260960:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a706f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.260993:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a706f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.261010:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a706f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581175.261032:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788581175.261298:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a706ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d915a expref: 38 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.261323:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a706f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d915a expref: 37 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.261333:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341e00) 00010000:00010000:2.0:1788581175.261337:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581175.261341:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb82e00, rc 0) 00000100:00100000:2.0:1788581175.261449:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+37:10532:x1875462995362688:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 2456us (3086us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788581175.261461:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 98 00000100:00100000:1.0:1788581175.269863:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581175.269932:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581175.270080:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995362944 00000100:00100000:2.0:1788581175.270095:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995362944 00000100:00100000:2.0:1788581175.270187:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 99 00000100:00100000:2.0:1788581175.270201:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+37:10532:x1875462995362944:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1788581175.270239:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581175.270286:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70702 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9161 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.270443:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70709 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.270463:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70709 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.270478:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70709 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581175.270520:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788581175.270702:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70702 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9161 expref: 40 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.270726:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70709 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9161 expref: 39 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.270737:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341e00) 00010000:00010000:2.0:1788581175.270740:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788581175.270744:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb83000, rc 0) 00000100:00100000:2.0:1788581175.270832:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+39:10532:x1875462995362944:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 634us (985us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788581175.270841:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 99 00000100:00100000:3.0:1788581175.272923:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995363072 00000100:00100000:3.0:1788581175.272944:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995363072 00000100:00100000:3.0:1788581175.273049:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:3.0:1788581175.273062:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+39:2374:x1875462995363072:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581175.273082:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581175.273117:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a706f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d915a expref: 39 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.273143:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341e00) 00010000:00010000:3.0:1788581175.273148:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581175.274033:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+38:2374:x1875462995363072:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 965us (4092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581175.274044:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:1.0:1788581175.282009:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581175.282140:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995363200 00000100:00100000:3.0:1788581175.282163:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995363200 00000100:00100000:3.0:1788581175.282281:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00100000:3.0:1788581175.282513:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2372:x1875462995363200:12345-192.168.201.13@tcp:1:lfs.0 00010000:00010000:3.0:1788581175.282590:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfe02d20/0xf54e3944c2a70717 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.282618:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b84d77e7/0xf54e3944c2a706d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d914c expref: 6 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.282628:0:10329:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581175.282633:0:10329:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581175.282639:0:10329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfe02d20/0xf54e3944c2a70717 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.282696:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b84d77e7/0xf54e3944c2a706d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d914c expref: 6 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.282713:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b84d77e7/0xf54e3944c2a706d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d914c expref: 6 pid: 6722 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581175.282731:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10329:1875463014257664:192.168.201.13@tcp:104: 00000100:00100000:3.0:1788581175.282889:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff919072187240 going to sleep for 11 seconds 00000100:00100000:3.0:1788581175.292741:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10329:1875463014257664:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581175.292801:0:10329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bfe02d20/0xf54e3944c2a70717 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581175.301874:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581175.302231:0:6730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995363328 00000100:00100000:3.0:1788581175.302275:0:6730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995363328 00002000:00100000:3.0:1788581175.302367:0:6730:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff91907f8b5500 x1875462995363328/t0(0) o4->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:531/0 lens 504/0 e 0 to 0 dl 1788581186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788581175.302381:0:6730:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91907f8b5500 with x1875462995363328 ext(0->8) 00010000:00010000:3.0:1788581175.302394:0:6730:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b84d77e7/0xf54e3944c2a706d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d914c expref: 7 pid: 6722 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.302415:0:6730:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b84d77e7/0xf54e3944c2a706d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d914c expref: 7 pid: 6722 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581175.302424:0:6730:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91907f8b5500 00000100:00100000:3.0:1788581175.302467:0:6730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:3.0:1788581175.302480:0:6730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2372:x1875462995363328:12345-192.168.201.13@tcp:4:lfs.0 00000100:00100000:3.0:1788581175.303119:0:6730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:2372:x1875462995363328:12345-192.168.201.13@tcp:4:lfs.0 Request processed in 637us (1254us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788581175.303129:0:6730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 1 00002000:00100000:3.0:1788581175.303137:0:6730:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff91907f8b5500 x1875462995363328/t4294967302(0) o4->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:531/0 lens 504/448 e 0 to 0 dl 1788581186 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788581175.303145:0:6730:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91907f8b5500 with x1875462995363328 ext(0->8) 00010000:00010000:3.0:1788581175.303151:0:6730:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b84d77e7/0xf54e3944c2a706d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d914c expref: 9 pid: 6722 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.303188:0:6730:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b84d77e7/0xf54e3944c2a706d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d914c expref: 9 pid: 6722 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581175.303196:0:6730:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91907f8b5500 00000100:00100000:0.0:1788581175.309546:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581175.310543:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995363456 00000100:00100000:3.0:1788581175.310565:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995363456 00010000:00010000:3.0:1788581175.310661:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b84d77e7/0xf54e3944c2a706d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d914c expref: 9 pid: 6722 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581175.310723:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:3.0:1788581175.310736:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:2375:x1875462995363456:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581175.310759:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788581175.310794:0:6739:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788581175.310797:0:6739:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788581174 00002000:00010000:3.0:1788581175.310800:0:6739:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788581174 00002000:00010000:3.0:1788581175.310803:0:6739:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788581174 00010000:00010000:3.0:1788581175.310810:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b84d77e7/0xf54e3944c2a706d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d914c expref: 9 pid: 6722 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.310829:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b84d77e7/0xf54e3944c2a706d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d914c expref: 9 pid: 6722 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.310859:0:6739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b84d77e7/0xf54e3944c2a706d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d914c expref: 9 pid: 6722 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.310899:0:6739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581175.310904:0:6739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581175.310910:0:6739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfe02d20/0xf54e3944c2a70717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.310917:0:6739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfe02d20/0xf54e3944c2a70717 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.310948:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581175.310981:0:10329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bfe02d20/0xf54e3944c2a70717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581175.310992:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfe02d20/0xf54e3944c2a70717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581175.311022:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfe02d20/0xf54e3944c2a70717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581175.311032:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfe02d20/0xf54e3944c2a70717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581175.311039:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2375:x1875462995363456:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 306us (1517us total) trans 0 rc 0/0 00010000:00010000:0.0:1788581175.311042:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfe02d20/0xf54e3944c2a70717 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581175.311047:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 50 00010000:00010000:0.0:1788581175.311050:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cec00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581175.311055:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfe02d20/0xf54e3944c2a70717 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581175.311065:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfe02d20/0xf54e3944c2a70717 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581175.311079:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfe02d20/0xf54e3944c2a70717 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581175.311101:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfe02d20/0xf54e3944c2a70717 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581175.311372:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2372:x1875462995363200:12345-192.168.201.13@tcp:1:lfs.0 Request processed in 29079us (29377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581175.311382:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00100000:2.0:1788581175.320379:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581175.323314:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995363712 00000100:00100000:0.0:1788581175.323336:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995363712 00000100:00100000:0.0:1788581175.323424:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 26 00000100:00100000:0.0:1788581175.323437:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190673cf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+38:10532:x1875462995363712:12345-192.168.201.13@tcp:35:lfs.0 00000004:00010000:0.0:1788581175.323541:0:5880:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70709 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9161 expref: 38 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788581175.324206:0:5880:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1788581175.324298:0:5880:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788581175.324743:0:5880:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1788581175.325931:0:5880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a7071e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581175.325961:0:5880:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a706c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d913e expref: 42 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581175.325971:0:5880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a7071e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581175.326024:0:5880:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a706c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d913e expref: 42 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581175.326065:0:5880:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a706c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d913e expref: 42 pid: 5877 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581175.326086:0:5880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5880:1875463014257792:192.168.201.13@tcp:104: 00000100:00100000:0.0:1788581175.327809:0:5880:0:(client.c:2715:ptlrpc_set_wait()) set ffff91905bdca6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581175.332296:0:5880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5880:1875463014257792:192.168.201.13@tcp:104: 00010000:00010000:0.0:1788581175.332341:0:5880:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a7071e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581175.334531:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581175.335111:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995363840 00000100:00100000:3.0:1788581175.335127:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995363840 00010000:00010000:3.0:1788581175.335193:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a706c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d913e expref: 43 pid: 5877 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581175.335316:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 51 00000100:00100000:3.0:1788581175.335329:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+43:2374:x1875462995363840:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581175.335351:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581175.335360:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a706c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d913e expref: 43 pid: 5877 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.335376:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a706c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d913e expref: 43 pid: 5877 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.335446:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a706c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d913e expref: 43 pid: 5877 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.335470:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341e00) 00010000:00010000:3.0:1788581175.335476:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a7071e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.335491:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a7071e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.335500:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a7071e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.335541:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581175.336462:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+42:2374:x1875462995363840:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 1127us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581175.336474:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 51 00010000:00010000:0.0:1788581175.337284:0:5880:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a7071e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581175.337299:0:5880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a7071e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788581175.337477:0:5880:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788581175.337760:0:5880:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1788581175.337916:0:5880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5880:1875463014257920:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788581175.338006:0:5880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581175.338077:0:5880:0:(client.c:2715:ptlrpc_set_wait()) set ffff91904ba236c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581175.338282:0:5882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014257920 00000100:00100000:1.0:1788581175.338292:0:5882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014257920 00000100:00100000:1.0:1788581175.338368:0:5882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788581175.338379:0:5882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5880:x1875463014257920:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788581175.338480:0:5882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5880:x1875463014257920:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 102us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581175.338508:0:5882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788581175.338568:0:5880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5880:1875463014257920:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788581175.339129:0:5880:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788581175.339221:0:5880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f8b6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5880:1875463014258048:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788581175.339330:0:5880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581175.339367:0:5882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014258048 00000100:00100000:1.0:1788581175.339373:0:5882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014258048 00000100:00100000:1.0:1788581175.339405:0:5882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581175.339412:0:5882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5880:x1875463014258048:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788581175.339575:0:5882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5880:x1875463014258048:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 162us (245us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788581175.339583:0:5882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581175.339610:0:5880:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581175.339633:0:5880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f8b6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5880:1875463014258048:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788581175.339681:0:5880:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788581175.339724:0:5880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a7071e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.339735:0:5880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a7071e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.339744:0:5880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a7071e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.339751:0:5880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581175.339757:0:5880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a7071e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.339778:0:5880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a7071e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.339801:0:5880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341e00) 00010000:00010000:1.0:1788581175.339805:0:5880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788581175.339811:0:5880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a7071e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.339818:0:5880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a7071e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788581175.340021:0:5880:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788581175.340150:0:5880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1788581175.340182:0:5880:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 391580938446ns, next at 392580934238ns, rc = 0 00000001:00080000:1.0:1788581175.340190:0:5880:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788581175.340228:0:5880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341e00) 00010000:00010000:1.0:1788581175.340231:0:5880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788581175.340240:0:5880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70709 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9161 expref: 46 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581175.340373:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190673cf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+45:10532:x1875462995363712:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 16939us (20011us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788581175.340381:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 26 00000020:00080000:1.0:1788581175.340386:0:5880:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1788581175.340992:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788581175.343435:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581175.344476:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581175.344784:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995363968 00000100:00100000:3.0:1788581175.344798:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995363968 00000100:00100000:3.0:1788581175.344913:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 100 00000100:00100000:3.0:1788581175.344927:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+45:10532:x1875462995363968:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581175.344961:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581175.344995:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70725 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9168 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.345083:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70725 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9168 expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.345125:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70725 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9168 expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.345181:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:3.0:1788581175.345186:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581175.345191:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf800, rc 0) 00000100:00100000:3.0:1788581175.345428:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+46:10532:x1875462995363968:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 503us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581175.345436:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 100 00000100:00100000:2.0:1788581175.350620:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581175.350903:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995364224 00000100:00100000:3.0:1788581175.350918:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995364224 00000100:00100000:3.0:1788581175.351024:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:3.0:1788581175.351034:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+46:10532:x1875462995364224:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:3.0:1788581175.351381:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+47:10532:x1875462995364224:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 347us (783us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1788581175.351388:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:3.0:1788581175.410470:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581175.410505:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014258176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581175.410622:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581175.411089:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014258176 00000100:00100000:1.0:1788581175.411104:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014258176 00000100:00100000:1.0:1788581175.411203:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788581175.411216:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3338:x1875463014258176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581175.411306:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581175.411381:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3338:x1875463014258176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581175.411390:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788581175.412064:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014258176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581175.459988:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581175.460117:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995364352 00000100:00100000:2.0:1788581175.460132:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995364352 00000100:00100000:2.0:1788581175.460231:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 101 00000100:00100000:2.0:1788581175.460288:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+47:10542:x1875462995364352:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:2.0:1788581175.460411:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7072c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.460447:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7072c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.460465:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7072c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.460507:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70733 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.460516:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.460524:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.460647:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7073a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.460657:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7073a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.460665:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7073a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581175.460722:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7073a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.460738:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7072c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.460744:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7072c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.460751:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7072c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.460757:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581175.461048:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7072c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.461063:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7072c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.461075:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:2.0:1788581175.461078:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581175.461081:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7072c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.461086:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7072c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.461098:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.461102:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70733 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.461235:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.461240:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581175.461304:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.461311:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70733 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.461320:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91905c525d00) 00010000:00010000:2.0:1788581175.461323:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581175.461326:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70733 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.461344:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70733 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.461362:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7073a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.461369:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7073a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.461374:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7073a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.461377:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581175.461379:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7073a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.461383:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7073a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.461389:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:2.0:1788581175.461390:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581175.461392:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7073a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.461396:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7073a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581175.461611:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+47:10542:x1875462995364352:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 1364us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581175.461619:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 101 00000100:00100000:0.0:1788581175.543477:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581175.547502:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995364608 00000100:00100000:2.0:1788581175.547533:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995364608 00000100:00100000:2.0:1788581175.547663:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 102 00000100:00100000:2.0:1788581175.547678:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+47:10545:x1875462995364608:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1788581175.547710:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581175.547741:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70741 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d916f expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.548040:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70748 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.548065:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70748 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.548081:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70748 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.548101:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7074f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.548109:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7074f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.548116:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7074f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.548607:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70756 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.548619:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.548880:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581175.548895:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788581175.549066:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70748 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.549074:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70748 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.549082:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70748 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.549090:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581175.549096:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70748 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.549105:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70748 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.549123:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:2.0:1788581175.549127:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581175.549135:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70748 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.549142:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70748 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.549168:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7074f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.549394:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7074f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.549411:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7074f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.549417:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581175.549420:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7074f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.549428:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7074f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.549438:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91905c525d00) 00010000:00010000:2.0:1788581175.549541:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581175.549547:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7074f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.549554:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a7074f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.549621:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70741 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d916f expref: 50 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.549637:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d916f expref: 49 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.549733:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:2.0:1788581175.549737:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581175.549740:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb82a00, rc 0) 00000100:00100000:2.0:1788581175.549906:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+49:10545:x1875462995364608:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 2229us (6455us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788581175.549927:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 102 00000100:00100000:0.0:1788581175.556179:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581175.556292:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995364736 00000100:00100000:1.0:1788581175.556309:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995364736 00000100:00100000:1.0:1788581175.556386:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 103 00000100:00100000:1.0:1788581175.556398:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+49:10545:x1875462995364736:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:1.0:1788581175.556635:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70764 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.556892:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.556908:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.556943:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.556950:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70764 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.556957:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70764 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.556962:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8e00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581175.556967:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70764 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.557073:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70764 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.557089:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:1.0:1788581175.557092:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581175.557098:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70764 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.557105:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70764 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581175.557335:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+49:10545:x1875462995364736:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 937us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581175.557344:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 103 00000100:00100000:3.0:1788581175.564222:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581175.564395:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995364992 00000100:00100000:1.0:1788581175.564410:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995364992 00000100:00100000:1.0:1788581175.564496:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 28 00000100:00100000:1.0:1788581175.564509:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+49:10545:x1875462995364992:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:1.0:1788581175.565027:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+50:10545:x1875462995364992:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 517us (897us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788581175.565036:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 28 00000100:00100000:0.0:1788581175.737050:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581175.737428:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995365248 00000100:00100000:3.0:1788581175.737447:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995365248 00000100:00100000:3.0:1788581175.737568:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 104 00000100:00100000:3.0:1788581175.737584:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f4370b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+50:10555:x1875462995365248:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1788581175.737884:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581175.737889:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788581175.737941:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a706e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9153 expref: 50 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.737972:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:3.0:1788581175.737993:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581175.738014:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a7076b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9176 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.738201:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70772 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.738220:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.738233:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581175.738323:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788581175.738924:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a7076b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9176 expref: 52 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.738948:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9176 expref: 51 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.738958:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:3.0:1788581175.738961:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581175.738964:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce000, rc 0) 00000100:00100000:3.0:1788581175.739431:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f4370b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+51:10555:x1875462995365248:12345-192.168.201.13@tcp:101:bash.0 Request processed in 1848us (2395us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788581175.739442:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 104 00000100:00100000:0.0:1788581175.745578:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581175.753227:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995365504 00000100:00100000:2.0:1788581175.753279:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995365504 00000100:00100000:2.0:1788581175.753394:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 105 00000100:00100000:2.0:1788581175.753411:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f4370bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+51:10555:x1875462995365504:12345-192.168.201.13@tcp:36:bash.0 00010000:00010000:2.0:1788581175.753523:0:5876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788581175.753564:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70772 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9176 expref: 51 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.753812:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70756 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d916f expref: 50 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.753829:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:2.0:1788581175.753836:0:5876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581175.754563:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70780 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.754585:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.756685:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581175.756875:0:5876:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788581175.756949:0:5876:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058483733 reply state 0000000042a705ca transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581175.756961:0:5876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788581175.757182:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f4370bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:10555:x1875462995365504:12345-192.168.201.13@tcp:36:bash.0 Request processed in 3768us (11617us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788581175.757194:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 105 00000020:00080000:2.0:1788581175.757202:0:5876:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788581175.761997:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581175.762088:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995365632 00000100:00100000:2.0:1788581175.762102:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995365632 00000100:00100000:2.0:1788581175.762197:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 106 00000100:00100000:2.0:1788581175.762211:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:10555:x1875462995365632:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:2.0:1788581175.762265:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581175.762301:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70787 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d917d expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.762419:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7078e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.762436:0:5878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70780 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.762443:0:5878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7078e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.762462:0:5878:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.762482:0:5878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7078e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.762928:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.762936:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70780 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.762941:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70780 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.762968:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581175.762972:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70780 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.762981:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70780 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.763003:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:1.0:1788581175.763007:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581175.763011:0:3324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7078e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.763019:0:3324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7078e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.763027:0:3324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7078e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.763084:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70780 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.763091:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70780 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.763390:0:5878:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7078e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.763400:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7078e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581175.763481:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788581175.763486:0:5878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788581175.763521:0:5878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7078e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.763560:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70787 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d917d expref: 53 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.763577:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7078e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d917d expref: 52 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.763584:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:2.0:1788581175.763901:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581175.763906:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb83200, rc 0) 00000100:00100000:2.0:1788581175.763998:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:10555:x1875462995365632:12345-192.168.201.13@tcp:101:bash.0 Request processed in 1787us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581175.764007:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 106 00000100:00100000:0.0:1788581175.772554:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581175.772860:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995365888 00000100:00100000:1.0:1788581175.772874:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995365888 00000100:00100000:1.0:1788581175.772947:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 29 00000100:00100000:1.0:1788581175.772960:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:10555:x1875462995365888:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:1.0:1788581175.773368:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+53:10555:x1875462995365888:12345-192.168.201.13@tcp:35:bash.0 Request processed in 410us (833us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788581175.773385:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 29 00000100:00100000:0.0:1788581175.833975:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581175.834101:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995366016 00000100:00100000:1.0:1788581175.834126:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995366016 00000100:00100000:1.0:1788581175.834340:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 107 00000100:00100000:1.0:1788581175.834355:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+53:10561:x1875462995366016:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1788581175.834393:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581175.834424:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70795 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9184 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.834579:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a7079c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.834607:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a7079c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.834622:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a7079c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581175.834671:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788581175.834675:0:9658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788581175.834697:0:9658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a7079c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.834728:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a70795 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9184 expref: 55 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.834751:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a7079c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9184 expref: 54 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.834774:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:1.0:1788581175.834777:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581175.834781:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8000, rc 0) 00000100:00100000:1.0:1788581175.834853:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:10561:x1875462995366016:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 501us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581175.834860:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 107 00000100:00100000:0.0:1788581175.838769:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581175.838868:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995366144 00000100:00100000:3.0:1788581175.838884:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995366144 00000100:00100000:3.0:1788581175.838965:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 108 00000100:00100000:3.0:1788581175.838976:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:10561:x1875462995366144:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581175.839004:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581175.839033:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a707a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d918b expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839122:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a707aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839138:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a707aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839160:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a707aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839179:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a707b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839188:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a707b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839194:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a707b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839356:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a707b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839381:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a707b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839386:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a707b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581175.839429:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788581175.839434:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581175.839456:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a707b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839472:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a707b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839481:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a707aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839489:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a707aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839496:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a707aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839503:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cfa00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581175.839509:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a707aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839518:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a707aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839533:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:3.0:1788581175.839535:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581175.839547:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a707aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839551:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a707aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839564:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a707b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839567:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a707b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839571:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a707b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839575:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581175.839576:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a707b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839579:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a707b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839583:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff919052341400) 00010000:00010000:3.0:1788581175.839585:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581175.839586:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a707b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839589:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a707b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839617:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a707a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d918b expref: 56 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839637:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a707b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d918b expref: 55 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.839643:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:3.0:1788581175.839644:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581175.839646:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce000, rc 0) 00000100:00100000:3.0:1788581175.839710:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:10561:x1875462995366144:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 737us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581175.839714:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 108 00000100:00100000:0.0:1788581175.843000:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581175.843133:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995366400 00000100:00100000:2.0:1788581175.843158:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995366400 00000100:00100000:2.0:1788581175.843429:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 109 00000100:00100000:2.0:1788581175.843448:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:10561:x1875462995366400:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1788581175.843493:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581175.843525:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a707bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9192 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.843697:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.843743:0:5876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7078e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d917d expref: 56 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.843753:0:5876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a707b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d918b expref: 56 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.843762:0:5876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.843816:0:5876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a707b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d918b expref: 56 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.843834:0:5876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a707b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d918b expref: 56 pid: 5877 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581175.843854:0:5876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5876:1875463014258304:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581175.843996:0:5876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7078e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d917d expref: 56 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.844005:0:5876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7078e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d917d expref: 56 pid: 5878 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581175.844015:0:5876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5876:1875463014258432:192.168.201.13@tcp:104: 00000100:00100000:2.0:1788581175.844044:0:5876:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c915480 going to sleep for 11 seconds 00000100:00100000:0.0:1788581175.845207:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581175.845379:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995366528 00000100:00100000:3.0:1788581175.845390:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995366528 00010000:00010000:3.0:1788581175.845443:0:5862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a707b8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d918b expref: 57 pid: 5877 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581175.845496:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 52 00000100:00100000:3.0:1788581175.845509:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:2374:x1875462995366528:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581175.845524:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581175.845532:0:5862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a707b8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d918b expref: 57 pid: 5877 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.845548:0:5862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a707b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d918b expref: 57 pid: 5877 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.845596:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:3.0:1788581175.845602:0:5862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.845628:0:5862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.845636:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581175.845691:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:2374:x1875462995366528:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 184us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581175.845699:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 52 00000100:00100000:0.0:1788581175.846999:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581175.847646:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995366656 00000100:00100000:3.0:1788581175.847659:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995366656 00010000:00010000:3.0:1788581175.847707:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7078e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d917d expref: 57 pid: 5878 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581175.847742:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 53 00000100:00100000:3.0:1788581175.847754:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:2374:x1875462995366656:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581175.847769:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581175.847776:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7078e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d917d expref: 57 pid: 5878 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.847791:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7078e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d917d expref: 57 pid: 5878 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.847817:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:3.0:1788581175.847821:0:5863:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.847833:0:5863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.847867:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.847891:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581175.847959:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:2374:x1875462995366656:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 207us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581175.847967:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 53 00010000:00010000:2.0:1788581175.850488:0:5876:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.13@tcp) returned -22 from blocking AST (req@00000000d64befa6 x1875463014258304) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a707b8 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d918b expref: 56 pid: 5877 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.850539:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a707b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d918b expref: 56 pid: 5877 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581175.850564:0:5876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5876:1875463014258304:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581175.850583:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7078e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d917d expref: 55 pid: 5878 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581175.850595:0:5876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5876:1875463014258432:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581175.850622:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:2.0:1788581175.850629:0:5876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.850638:0:5876:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.850642:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581175.850665:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788581175.850858:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a707bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9192 expref: 56 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.850869:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9192 expref: 55 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.850875:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:2.0:1788581175.850884:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788581175.850887:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb82a00, rc 0) 00000100:00100000:2.0:1788581175.850968:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:10561:x1875462995366400:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 7526us (7986us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788581175.850977:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 109 00000100:00100000:0.0:1788581175.853695:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581175.853849:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995366912 00000100:00100000:3.0:1788581175.853861:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995366912 00000100:00100000:3.0:1788581175.853942:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:3.0:1788581175.853954:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:10561:x1875462995366912:12345-192.168.201.13@tcp:103:lfs.0 00010000:00010000:3.0:1788581175.853971:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581175.854004:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70725 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9168 expref: 55 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581175.854026:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:3.0:1788581175.854032:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581175.854221:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:10561:x1875462995366912:12345-192.168.201.13@tcp:103:lfs.0 Request processed in 268us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581175.854227:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:3.0:1788581175.856170:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581175.856506:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995367040 00000100:00100000:2.0:1788581175.856519:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995367040 00000100:00100000:2.0:1788581175.856620:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 110 00000100:00100000:2.0:1788581175.856628:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:10561:x1875462995367040:12345-192.168.201.13@tcp:58:lfs.0 00010000:00010000:2.0:1788581175.856776:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a707d4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.856794:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a707d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581175.856805:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a707d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788581175.857058:0:5877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788581175.857193:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:10561:x1875462995367040:12345-192.168.201.13@tcp:58:lfs.0 Request processed in 564us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581175.857202:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 110 00000100:00100000:3.0:1788581175.858890:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581175.858980:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995367168 00000100:00100000:1.0:1788581175.858991:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995367168 00000100:00100000:1.0:1788581175.859039:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 111 00000100:00100000:1.0:1788581175.859049:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:10561:x1875462995367168:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1788581175.859069:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581175.859091:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a707db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9199 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.859190:0:9658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a707d4 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.859205:0:9658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a707db lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9199 expref: 55 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.859235:0:9658:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a707d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.859279:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a707db lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9199 expref: 55 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.859297:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:1.0:1788581175.859323:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788581175.859329:0:9658:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a707db lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9199 expref: 55 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581175.859338:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8e00, rc 0) 00000100:00100000:1.0:1788581175.859407:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:10561:x1875462995367168:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 359us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581175.859413:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 111 00000001:00080000:0.0:1788581175.964063:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1788581175.964856:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:3.0:1788581176.367477:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788581176.687599:0:11735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788581176.687613:0:11735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788581176.687660:0:11735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788581176.687668:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788581176.688119:0:11735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907611ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11735:1875463014258560:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788581176.688388:0:11735:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190721879c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581176.692646:0:11735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907611ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11735:1875463014258560:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788581176.694349:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581176.694525:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995367296 00000100:00100000:0.0:1788581176.694550:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995367296 00000100:00100000:0.0:1788581176.694778:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 112 00000100:00100000:0.0:1788581176.694794:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:10563:x1875462995367296:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788581176.694841:0:5878:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1788581176.695708:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581176.695843:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:10563:x1875462995367296:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 1046us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581176.695856:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 112 00000100:00100000:0.0:1788581176.708305:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581176.710306:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995367424 00000100:00100000:1.0:1788581176.710328:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995367424 00000100:00100000:1.0:1788581176.710435:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 113 00000100:00100000:1.0:1788581176.710449:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:10563:x1875462995367424:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788581176.710581:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a707e2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710604:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a707e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710618:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a707e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710639:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a707e9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710647:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a707e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710654:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a707e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710708:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a707f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710717:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a707f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710724:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a707f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581176.710779:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788581176.710784:0:9658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788581176.710801:0:9658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a707f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710815:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a707e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710822:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a707e2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710829:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a707e2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710835:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581176.710839:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a707e2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710847:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a707e2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710861:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91904995af00) 00010000:00010000:1.0:1788581176.710870:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581176.710876:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a707e2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710883:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a707e2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710900:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a707e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710905:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a707e9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710912:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a707e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710918:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581176.710921:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a707e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710928:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a707e9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710935:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff91905c6f1600) 00010000:00010000:1.0:1788581176.710937:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581176.710940:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a707e9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710945:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a707e9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710965:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a707f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710991:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a707f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.710998:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a707f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.711003:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9c00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581176.711006:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a707f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.711011:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a707f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.711020:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:1.0:1788581176.711022:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581176.711025:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a707f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.711031:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a707f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581176.711163:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:10563:x1875462995367424:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 Request processed in 715us (2920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581176.711172:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 113 00000100:00100000:3.0:1788581176.731438:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581176.732182:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995367680 00000100:00100000:2.0:1788581176.732203:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995367680 00000100:00100000:2.0:1788581176.732332:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 114 00000100:00100000:2.0:1788581176.732345:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907611ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:10563:x1875462995367680:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581176.732377:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581176.732422:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a707f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d91a0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.732866:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a707fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.732887:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a707fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.732901:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a707fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581176.732915:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788581176.733062:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a707fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.733071:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a707fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.733078:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a707fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.733085:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb82200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581176.733091:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a707fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.733100:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a707fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.733119:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:2.0:1788581176.733123:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788581176.733140:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a707fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.733165:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a707fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.733231:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a707f7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91a0 expref: 57 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.733314:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91904995af00) 00010000:00010000:2.0:1788581176.733317:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788581176.733322:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a707f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91a0 expref: 57 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.733333:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb83200, rc 0) 00000100:00100000:2.0:1788581176.733438:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907611ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+56:10563:x1875462995367680:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 1094us (2016us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788581176.733447:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 114 00000100:00100000:3.0:1788581176.744082:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581176.744903:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995367808 00000100:00100000:1.0:1788581176.744922:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995367808 00000100:00100000:1.0:1788581176.745025:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 115 00000100:00100000:1.0:1788581176.745038:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+56:10563:x1875462995367808:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788581176.745093:0:9658:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788581176.745887:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+56:10563:x1875462995367808:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 843us (1812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581176.745900:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 115 00000100:00100000:2.0:1788581176.751700:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581176.754110:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995368064 00000100:00100000:3.0:1788581176.754143:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995368064 00000100:00100000:3.0:1788581176.754499:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 116 00000100:00100000:3.0:1788581176.754512:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+56:10563:x1875462995368064:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581176.754553:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581176.754557:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788581176.754604:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a7079c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9184 expref: 56 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581176.754631:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:3.0:1788581176.754636:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581176.754655:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a7080c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d91a7 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788581176.755230:0:5877:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788581176.755596:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70813 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581176.755617:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581176.755630:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581176.755735:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a7080c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91a7 expref: 58 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581176.755756:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91a7 expref: 57 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581176.755764:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff919052341500) 00010000:00010000:3.0:1788581176.755767:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581176.755769:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf800, rc 0) 00000100:00100000:3.0:1788581176.755873:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:10563:x1875462995368064:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 1361us (4192us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788581176.755884:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 116 00000100:00100000:2.0:1788581176.761368:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581176.762976:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995368320 00000100:00100000:1.0:1788581176.762999:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995368320 00000100:00100000:1.0:1788581176.763108:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 117 00000100:00100000:1.0:1788581176.763122:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:10563:x1875462995368320:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788581176.763226:0:5876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581176.763314:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70813 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91a7 expref: 57 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.763340:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff919052341500) 00010000:00010000:1.0:1788581176.763354:0:5876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581176.763389:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a70821 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.763407:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a70821 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.763417:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a70821 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.763448:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70828 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x4f8cbb9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.763456:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f8cbb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.763463:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f8cbb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.764090:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a70821 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.764353:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a70821 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.764361:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a70821 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.764369:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581176.764374:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a70821 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.764383:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a70821 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.764396:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:1.0:1788581176.764399:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581176.764405:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a70821 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.764412:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a70821 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.764489:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f8cbb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.764496:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70828 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f8cbb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.764501:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70828 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f8cbb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.764523:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581176.764526:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70828 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f8cbb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.764533:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70828 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f8cbb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.765107:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x4f8cbb9e (ffff91905c6f1600) 00010000:00010000:1.0:1788581176.765114:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581176.765119:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70828 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4f8cbb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581176.765126:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70828 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4f8cbb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581176.767754:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+56:10563:x1875462995368320:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 4613us (6388us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788581176.767772:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 117 00000100:00100000:3.0:1788581176.781631:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581176.781792:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995368448 00000100:00100000:2.0:1788581176.781809:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995368448 00000100:00100000:2.0:1788581176.781893:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 118 00000100:00100000:2.0:1788581176.781907:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+56:10563:x1875462995368448:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581176.781939:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581176.781972:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7082f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d91ae expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.782020:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70836 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.782057:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.782084:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.782236:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7082f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ae expref: 58 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.782348:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70836 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ae expref: 57 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.782360:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91905c525d00) 00010000:00010000:2.0:1788581176.782363:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788581176.782366:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb82200, rc 0) 00000100:00100000:2.0:1788581176.782456:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:10563:x1875462995368448:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 551us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581176.782464:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 118 00000100:00100000:0.0:1788581176.790845:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581176.792000:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995368704 00000100:00100000:2.0:1788581176.792019:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995368704 00000100:00100000:2.0:1788581176.792141:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 119 00000100:00100000:2.0:1788581176.792155:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:10563:x1875462995368704:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788581176.792309:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7083d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.792333:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7083d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.792373:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7083d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788581176.792723:0:9658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788581176.792736:0:9658:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 393033492090ns, next at 394033488741ns, rc = 0 00000004:00010000:2.0:1788581176.792849:0:9658:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c505e4a reply state 000000001621f5aa transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7083d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581176.792861:0:9658:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788581176.793009:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:10563:x1875462995368704:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 856us (2179us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788581176.793017:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 119 00010000:00010000:2.0:1788581176.804452:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7083d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.804481:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7083d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.804491:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7083d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.804499:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581176.804506:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7083d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.804516:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7083d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.804621:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91905c525d00) 00010000:00010000:2.0:1788581176.804626:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788581176.804658:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7083d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.804666:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7083d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581176.807116:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581176.807387:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995368832 00000100:00100000:2.0:1788581176.807403:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995368832 00000100:00100000:2.0:1788581176.807483:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 120 00000100:00100000:2.0:1788581176.807496:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:10563:x1875462995368832:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581176.807533:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581176.807573:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70844 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d91b5 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.807665:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70844 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91b5 expref: 59 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.807683:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70844 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91b5 expref: 59 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.807707:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91905c525d00) 00010000:00010000:2.0:1788581176.807710:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788581176.807714:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb82e00, rc 0) 00000100:00100000:2.0:1788581176.807795:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:10563:x1875462995368832:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 301us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581176.807803:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 120 00000100:00100000:3.0:1788581176.812703:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581176.814386:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995368960 00000100:00100000:0.0:1788581176.814410:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995368960 00000100:00100000:0.0:1788581176.814515:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:0.0:1788581176.814529:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2373:x1875462995368960:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788581176.814990:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:2373:x1875462995368960:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 463us (2302us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788581176.814999:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:1.0:1788581176.818759:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581176.819058:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995369216 00000100:00100000:0.0:1788581176.819088:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995369216 00000100:00100000:0.0:1788581176.819174:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 30 00000100:00100000:0.0:1788581176.819187:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:10563:x1875462995369216:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788581176.819544:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+60:10563:x1875462995369216:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 359us (799us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788581176.819553:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 30 00000100:00100000:1.0:1788581176.822831:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581176.822969:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995369472 00000100:00100000:2.0:1788581176.822982:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995369472 00000100:00100000:2.0:1788581176.823101:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 121 00000100:00100000:2.0:1788581176.823166:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+60:10563:x1875462995369472:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788581176.823391:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+60:10563:x1875462995369472:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 230us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581176.823400:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 121 00000100:00100000:3.0:1788581176.826798:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581176.826906:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995369600 00000100:00100000:0.0:1788581176.826920:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995369600 00000100:00100000:0.0:1788581176.826997:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 122 00000100:00100000:0.0:1788581176.827011:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+60:10563:x1875462995369600:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581176.827038:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581176.827068:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a7084b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d91bc expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581176.827213:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70852 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581176.827236:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581176.827279:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581176.827338:0:5878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788581176.827368:0:5878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581176.827408:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a7084b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91bc expref: 62 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581176.827697:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70852 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91bc expref: 61 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581176.827708:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91905c525d00) 00010000:00010000:0.0:1788581176.827711:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788581176.827716:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22200, rc 0) 00000100:00100000:0.0:1788581176.827805:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+61:10563:x1875462995369600:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 796us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581176.827813:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 122 00000100:00100000:3.0:1788581176.832397:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581176.832604:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995369728 00000100:00100000:0.0:1788581176.832619:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995369728 00000100:00100000:0.0:1788581176.832696:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 38 00000100:00100000:0.0:1788581176.832708:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:2375:x1875462995369728:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581176.832733:0:6723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581176.832761:0:6723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a70859 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d91c3 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788581176.832801:0:6723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b9538, blocks: 0x1 00010000:00010000:0.0:1788581176.832829:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788581176.832836:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581176.832848:0:6723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a70859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91c3 expref: 10 pid: 6723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581176.832870:0:6723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a70859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91c3 expref: 10 pid: 6723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581176.832912:0:6723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22400, rc 0) 00000100:00100000:0.0:1788581176.832986:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+10:2375:x1875462995369728:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 279us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581176.832994:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 38 00000100:00100000:1.0:1788581176.837054:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581176.837489:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995369984 00000100:00100000:2.0:1788581176.837504:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995369984 00000100:00100000:2.0:1788581176.837707:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 123 00000100:00100000:2.0:1788581176.837722:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+61:10563:x1875462995369984:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788581176.837888:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+61:10563:x1875462995369984:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 169us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581176.837898:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 123 00000100:00100000:3.0:1788581176.842524:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581176.842747:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995370112 00000100:00100000:0.0:1788581176.842762:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995370112 00000100:00100000:0.0:1788581176.842844:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 39 00000100:00100000:0.0:1788581176.842859:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+10:10563:x1875462995370112:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581176.842884:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581176.842912:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a70860 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d91ca expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581176.842961:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a70859 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91c3 expref: 11 pid: 6723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581176.842970:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581176.842975:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581176.842980:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a70860 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ca expref: 11 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581176.843026:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a70859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91c3 expref: 11 pid: 6723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581176.843042:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a70859 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91c3 expref: 11 pid: 6723 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581176.843084:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6725:1875463014258688:192.168.201.13@tcp:104: 00000100:00100000:0.0:1788581176.843276:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190525776c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581176.859842:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581176.861543:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995370240 00000100:00100000:2.0:1788581176.861567:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995370240 00010000:00010000:2.0:1788581176.861645:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a70859 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91c3 expref: 12 pid: 6723 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581176.861709:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 54 00000100:00100000:2.0:1788581176.861722:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+12:2374:x1875462995370240:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581176.861748:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581176.861783:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a70859 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91c3 expref: 12 pid: 6723 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.861802:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a70859 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91c3 expref: 12 pid: 6723 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.861863:0:5863:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581176.861869:0:5863:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581176.861881:0:5863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a70860 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ca expref: 12 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.861895:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a70860 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ca expref: 12 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581176.861947:0:5863:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a70860 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ca expref: 12 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581176.861964:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5863:1875463014258816:192.168.201.13@tcp:105: 00000100:00100000:2.0:1788581176.862102:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c9156c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788581176.865650:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a70859 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91c3 expref: 12 pid: 6723 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581176.865681:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6725:1875463014258688:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581176.865721:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a70860 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ca expref: 11 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581176.865740:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22600, rc 0) 00000100:00100000:3.0:1788581176.868695:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5863:1875463014258816:192.168.201.13@tcp:105: 00010000:00010000:3.0:1788581176.868734:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581176.868811:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+11:2374:x1875462995370240:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 7090us (8985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581176.868825:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 54 00000100:00100000:2.0:1788581176.873548:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+10:10563:x1875462995370112:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 30665us (31015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581176.873567:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 39 00000100:00100000:1.0:1788581176.879553:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581176.879689:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995370368 00000100:00100000:0.0:1788581176.879704:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995370368 00002000:00100000:0.0:1788581176.879783:0:6728:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff91907be17480 x1875462995370368/t0(0) o4->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:532/0 lens 504/0 e 0 to 0 dl 1788581187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788581176.879796:0:6728:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91907be17480 with x1875462995370368 ext(0->12) 00002000:00010000:0.0:1788581176.879803:0:6728:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91907be17480 00000100:00100000:0.0:1788581176.879845:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:0.0:1788581176.879858:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+10:2375:x1875462995370368:12345-192.168.201.13@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788581176.880838:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+12:2375:x1875462995370368:12345-192.168.201.13@tcp:4:lhsmtool_posix.0 Request processed in 973us (1307us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788581176.880851:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 2 00002000:00100000:0.0:1788581176.880862:0:6728:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff91907be17480 x1875462995370368/t4294967308(0) o4->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:532/0 lens 504/448 e 0 to 0 dl 1788581187 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788581176.880872:0:6728:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91907be17480 with x1875462995370368 ext(0->12) 00002000:00010000:0.0:1788581176.880877:0:6728:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91907be17480 00000100:00100000:1.0:1788581176.888804:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581176.888922:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995370496 00000100:00100000:3.0:1788581176.888939:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995370496 00000100:00100000:3.0:1788581176.889022:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 124 00000100:00100000:3.0:1788581176.889035:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+61:10563:x1875462995370496:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788581177.055073:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788581177.055142:0:5899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788581177.055357:0:5899:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9190485c4840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788581177.055364:0:5899:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff919047d48e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9190485c4e40 00000020:00080000:3.0:1788581177.055368:0:5899:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff919047d48600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91907b82c000 00000004:00080000:3.0:1788581177.055399:0:5899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1788581177.055432:0:5899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788581177.055483:0:5899:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91905248da80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788581177.055487:0:5899:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91907fbf6300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91905248d480 00000020:00080000:3.0:1788581177.055491:0:5899:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91907fbf6600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff919076bc6c00 00000020:00080000:3.0:1788581177.055507:0:5899:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1788581177.055748:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014258944:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788581177.055872:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581177.055960:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581177.055967:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014259072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788581177.055992:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581177.056053:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014258944 00000100:00100000:3.0:1788581177.056063:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014258944 00000020:00080000:1.0:1788581177.056419:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788581177.056729:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00080000:1.0:1788581177.056747:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581177.057082:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+15:10563:x1875462995370496:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 Request processed in 168041us (168286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581177.057098:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 124 00000100:00100000:0.0:1788581177.057181:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014259072 00000100:00100000:0.0:1788581177.057200:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014259072 00000100:00100000:0.0:1788581177.057292:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788581177.057303:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3340:x1875463014258944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788581177.057347:0:6723:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1788581177.057397:0:6723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70867 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.057428:0:6723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a70629 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9129 expref: 11 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.057440:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1788581177.057445:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581177.057451:0:6723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70867 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.057500:0:6723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a70629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9129 expref: 11 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.057520:0:6723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a70629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9129 expref: 11 pid: 6722 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581177.057551:0:6723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6723:1875463014259200:192.168.201.13@tcp:104: 00000100:00100000:0.0:1788581177.057613:0:6723:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907ba28000 going to sleep for 11 seconds 00000100:00100000:0.0:1788581177.057638:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788581177.057648:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3340:x1875463014259072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788581177.057842:0:6725:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788581177.057854:0:6725:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788581176 00002000:00010000:0.0:1788581177.057857:0:6725:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788581177.057860:0:6725:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788581176 -> 1788581176 00002000:00010000:0.0:1788581177.057864:0:6725:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788581177.057946:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3340:x1875463014259072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 299us (1951us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788581177.057953:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:0.0:1788581177.058009:0:3340:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91906c61c000/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788581177.058018:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014259072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788581177.058835:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014259328:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788581177.058895:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581177.062900:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581177.062982:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581177.063026:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995370752 00000100:00100000:3.0:1788581177.063038:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995370752 00010000:00010000:3.0:1788581177.063111:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a70629 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9129 expref: 12 pid: 6722 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581177.063358:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014259328 00000100:00100000:2.0:1788581177.063364:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014259328 00000100:00100000:2.0:1788581177.063412:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995370624 00000100:00100000:2.0:1788581177.063415:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995370624 00000100:00100000:2.0:1788581177.063436:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788581177.063450:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014259328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788581177.063493:0:6725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1788581177.063558:0:6725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9b9536, atime: 0x6a9b9536, ctime: 0x6a9b9536, blocks: 0xb 00010000:00010000:2.0:1788581177.063568:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a768f23/0xf54e3944c2a7086e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.063608:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788581177.063615:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581177.063623:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a768f23/0xf54e3944c2a7086e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.063645:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a768f23/0xf54e3944c2a7086e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.063656:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a768f23/0xf54e3944c2a7086e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.063665:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a768f23/0xf54e3944c2a7086e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.063683:0:6725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1788581177.064604:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788581177.064615:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581177.064826:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 55 00000100:00100000:3.0:1788581177.064848:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:2375:x1875462995370752:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581177.064869:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581177.064883:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a70629 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9129 expref: 13 pid: 6722 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.064906:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a70629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9129 expref: 13 pid: 6722 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.064943:0:6739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581177.064951:0:6739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581177.064960:0:6739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.064971:0:6739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70867 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.065020:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581177.065850:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581177.065866:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a768f23/0xf54e3944c2a7086e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.065878:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83200 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581177.065884:0:5865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a768f23/0xf54e3944c2a7086e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.065897:0:5865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a768f23/0xf54e3944c2a7086e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.065917:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a768f23/0xf54e3944c2a7086e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.065925:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a768f23/0xf54e3944c2a7086e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.065959:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581177.065972:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581177.065974:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581177.066071:0:6723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a70629 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9129 expref: 13 pid: 6722 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581177.066087:0:6723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6723:1875463014259200:192.168.201.13@tcp:104: 00010000:00010000:0.0:1788581177.066134:0:6723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.066320:0:6723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.066330:0:6723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.066344:0:6723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.066354:0:6723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70867 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.066380:0:6723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788581177.067038:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014259328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3583us (8135us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788581177.067051:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788581177.067100:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 43 00000100:00100000:3.0:1788581177.067767:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+12:2375:x1875462995370752:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 2923us (4777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581177.067783:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 55 00000100:00100000:3.0:1788581177.067891:0:3338:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788581177.067900:0:3338:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:3.0:1788581177.067935:0:3338:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91907611f800, transno 4294967301 00000004:00080000:3.0:1788581177.067957:0:3338:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:3.0:1788581177.067982:0:3338:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff91906c7e0a80 x1875463014259328/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788581193 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788581177.067998:0:3338:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91906c7e0a80/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788581177.068004:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014259328:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788581177.068929:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+11:2374:x1875462995370624:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788581177.069649:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3340:x1875463014258944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12343us (13773us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788581177.069663:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788581177.069724:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581177.069733:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70867 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.069758:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23a00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581177.069763:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70867 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.069776:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70867 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.069806:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70867 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.069815:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70867 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.069841:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581177.069844:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581177.069846:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788581177.072922:0:3340:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9190768b6680/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788581177.072948:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014258944:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788581177.133770:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1788581177.133799:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1788581177.134636:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995370624:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 Request processed in 67512us (71739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581177.134651:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 43 00000100:00100000:0.0:1788581177.144833:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581177.144948:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995371008 00000100:00100000:2.0:1788581177.144974:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995371008 00000100:00100000:2.0:1788581177.145075:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 125 00000100:00100000:2.0:1788581177.145088:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+15:10563:x1875462995371008:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788581177.145399:0:5878:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581177.145453:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70852 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91bc expref: 15 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.145479:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91905c525d00) 00010000:00010000:2.0:1788581177.145485:0:5878:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581177.145531:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70875 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.145560:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.145572:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581177.145906:0:5878:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000390eb436 reply state 00000000374f05e9 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581177.145918:0:5878:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788581177.146613:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+16:10563:x1875462995371008:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 1522us (1790us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788581177.146624:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 125 00000100:00100000:3.0:1788581177.150763:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581177.151001:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995371136 00000100:00100000:1.0:1788581177.151017:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995371136 00000100:00100000:1.0:1788581177.151094:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:1.0:1788581177.151107:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995371136:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788581177.151563:0:10329:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788581177.151569:0:10329:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788581176 -> 1788581175 00002000:00010000:1.0:1788581177.151572:0:10329:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788581174 00002000:00010000:1.0:1788581177.151574:0:10329:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788581176 -> 1788581175 00002000:00010000:1.0:1788581177.151577:0:10329:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788581177.151655:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2374:x1875462995371136:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 549us (909us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788581177.151664:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 44 00010000:00010000:2.0:1788581177.153317:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.153337:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70875 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.153374:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70875 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.153382:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581177.153388:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70875 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.153397:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70875 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.153434:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91905c525d00) 00010000:00010000:2.0:1788581177.153439:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581177.153445:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70875 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.153452:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70875 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581177.155795:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581177.155900:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995371392 00000100:00100000:2.0:1788581177.155914:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995371392 00000100:00100000:2.0:1788581177.156006:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 126 00000100:00100000:2.0:1788581177.156019:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+15:10563:x1875462995371392:12345-192.168.201.13@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788581177.156196:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7087c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.156216:0:9658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70836 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ae expref: 15 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.156226:0:9658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7087c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.156331:0:9658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70836 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ae expref: 15 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.156350:0:9658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70836 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ae expref: 15 pid: 5877 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581177.156369:0:9658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9658:1875463014259456:192.168.201.13@tcp:104: 00000100:00100000:2.0:1788581177.156918:0:9658:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c915180 going to sleep for 11 seconds 00000100:00100000:2.0:1788581177.162044:0:9658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9658:1875463014259456:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581177.162096:0:9658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7087c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581177.170576:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581177.170691:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995371520 00000100:00100000:0.0:1788581177.170704:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995371520 00010000:00010000:0.0:1788581177.170765:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70836 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ae expref: 16 pid: 5877 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581177.170819:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 56 00000100:00100000:0.0:1788581177.170850:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+16:2374:x1875462995371520:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581177.170870:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581177.170879:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70836 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ae expref: 16 pid: 5877 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.170894:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70836 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ae expref: 16 pid: 5877 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.170923:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70836 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ae expref: 16 pid: 5877 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.170942:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91905c525d00) 00010000:00010000:0.0:1788581177.170947:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7087c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.170970:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7087c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.170979:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7087c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.171019:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581177.171104:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+15:2374:x1875462995371520:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 256us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581177.171114:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 56 00010000:00010000:2.0:1788581177.171309:0:9658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7087c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.171319:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7087c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.171357:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7087c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.171363:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7087c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.171370:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7087c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.171376:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581177.171381:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7087c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.171398:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7087c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.171410:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91905c525d00) 00010000:00010000:2.0:1788581177.171413:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788581177.171417:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7087c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.171423:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a7087c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581177.171486:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+14:10563:x1875462995371392:12345-192.168.201.13@tcp:55:lhsmtool_posix.0 Request processed in 15470us (15707us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788581177.171496:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 126 00000100:00100000:1.0:1788581177.184490:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581177.184672:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995371648 00000100:00100000:0.0:1788581177.184687:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995371648 00000100:00100000:0.0:1788581177.184769:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:0.0:1788581177.184783:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2372:x1875462995371648:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788581177.184865:0:6723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70883 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.184892:0:6723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a70860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ca expref: 7 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.184902:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581177.184907:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788581177.184914:0:6723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70883 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.184965:0:6723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a70860 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ca expref: 7 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.184984:0:6723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a70860 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ca expref: 7 pid: 6725 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581177.185003:0:6723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906ca94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6723:1875463014259584:192.168.201.13@tcp:104: 00000100:00100000:0.0:1788581177.185149:0:6723:0:(client.c:2715:ptlrpc_set_wait()) set ffff919049fb5300 going to sleep for 11 seconds 00000100:00100000:0.0:1788581177.210378:0:6723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906ca94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6723:1875463014259584:192.168.201.13@tcp:104: 00000100:00100000:1.0:1788581177.210892:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581177.211183:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995371776 00000100:00100000:3.0:1788581177.211194:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995371776 00010000:00010000:3.0:1788581177.211308:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a70860 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ca expref: 8 pid: 6725 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581177.211357:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 57 00000100:00100000:3.0:1788581177.211371:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f85a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2374:x1875462995371776:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581177.211395:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581177.211442:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a70860 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ca expref: 8 pid: 6725 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.211459:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a70860 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ca expref: 8 pid: 6725 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.211514:0:6739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a70860 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ca expref: 8 pid: 6725 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.211544:0:6739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581177.211550:0:6739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581177.211559:0:6739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70883 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.211571:0:6739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70883 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.211598:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581177.211686:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f85a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2374:x1875462995371776:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 317us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581177.211696:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 57 00010000:00010000:0.0:1788581177.212427:0:6723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70883 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.212448:0:6723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70883 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.212476:0:6723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70883 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.212518:0:6723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70883 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.212527:0:6723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70883 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.212548:0:6723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70883 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.212556:0:6723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23a00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581177.212562:0:6723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70883 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.212573:0:6723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70883 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.212589:0:6723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70883 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.212596:0:6723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8073c89/0xf54e3944c2a70883 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581177.212688:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2372:x1875462995371648:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 Request processed in 27906us (28211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581177.212699:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:1.0:1788581177.216901:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581177.217176:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995372032 00000100:00100000:0.0:1788581177.217191:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995372032 00000100:00100000:0.0:1788581177.217296:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 127 00000100:00100000:0.0:1788581177.217311:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+14:10563:x1875462995372032:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788581177.218196:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a7088a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.218223:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a7088a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.218238:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a7088a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.231639:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70891 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.231677:0:5878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70844 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91b5 expref: 15 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.231688:0:5878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70891 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.231750:0:5878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70844 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91b5 expref: 15 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.231770:0:5878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70844 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91b5 expref: 15 pid: 5877 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581177.231817:0:5878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5878:1875463014259712:192.168.201.13@tcp:104: 00000100:00100000:2.0:1788581177.232039:0:5878:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c915180 going to sleep for 11 seconds 00000100:00100000:2.0:1788581177.238740:0:5878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5878:1875463014259712:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581177.238783:0:5878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70891 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581177.250917:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581177.251067:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995372160 00000100:00100000:0.0:1788581177.251080:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995372160 00010000:00010000:0.0:1788581177.251153:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70844 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91b5 expref: 16 pid: 5877 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581177.251205:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 58 00000100:00100000:0.0:1788581177.251217:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+16:2375:x1875462995372160:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581177.251237:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581177.251276:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70844 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91b5 expref: 16 pid: 5877 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.251317:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70844 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91b5 expref: 16 pid: 5877 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.251348:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a70844 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91b5 expref: 16 pid: 5877 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.251371:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91905c525d00) 00010000:00010000:0.0:1788581177.251378:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70891 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.251390:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70891 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.251401:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70891 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.251606:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581177.251749:0:5878:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70891 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.251758:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70891 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581177.252015:0:5878:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788581177.252210:0:5878:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788581177.252307:0:5878:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788581177.252560:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:2375:x1875462995372160:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 1339us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581177.252571:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 58 00000100:00100000:2.0:1788581177.252713:0:5878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5878:1875463014259840:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788581177.252782:0:5878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581177.252832:0:5878:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c915840 going to sleep for 11 seconds 00000100:00100000:0.0:1788581177.255878:0:5882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014259840 00000100:00100000:0.0:1788581177.255901:0:5882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014259840 00000100:00100000:0.0:1788581177.256002:0:5882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581177.256015:0:5882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5878:x1875463014259840:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788581177.256217:0:5882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5878:x1875463014259840:12345-0@lo:1000:mdt00_002.0 Request processed in 204us (3433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581177.256227:0:5882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788581177.257475:0:5878:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788581177.257491:0:5878:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1788581177.257521:0:5878:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91906c61c000, transno 4294967309 00000004:00080000:3.0:1788581177.257550:0:5878:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9190768b6680, transno 4294967310 00000100:00100000:3.0:1788581177.257571:0:5878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5878:1875463014259840:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788581177.259891:0:5878:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788581177.260015:0:5878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5878:1875463014259968:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788581177.263603:0:5878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581177.263717:0:5878:0:(client.c:2715:ptlrpc_set_wait()) set ffff919049984c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581177.265926:0:5882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014259968 00000100:00100000:0.0:1788581177.265949:0:5882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014259968 00000100:00100000:0.0:1788581177.266037:0:5882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581177.266051:0:5882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5878:x1875463014259968:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788581177.266936:0:5882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5878:x1875463014259968:12345-0@lo:1000:mdt00_002.0 Request processed in 880us (6811us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788581177.266949:0:5882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581177.267072:0:5878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5878:1875463014259968:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788581177.267175:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70891 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.267188:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70891 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.267198:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70891 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.267205:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581177.267211:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70891 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.267222:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70891 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.267275:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91905c525d00) 00010000:00010000:3.0:1788581177.267280:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581177.267286:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70891 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.267293:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70891 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.267333:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a707d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.267341:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a707d4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.267348:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a707d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.267363:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581177.267367:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a707d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.267374:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a707d4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.267385:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:3.0:1788581177.267387:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581177.267396:0:5878:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a707db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9199 expref: 18 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.267410:0:5878:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a707db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9199 expref: 18 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.267838:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a707db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9199 expref: 18 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.267892:0:5878:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a707db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9199 expref: 18 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581177.267912:0:5878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5878:1875463014260096:192.168.201.13@tcp:105: 00000100:00100000:3.0:1788581177.268035:0:5878:0:(client.c:2715:ptlrpc_set_wait()) set ffff919049984c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581177.272704:0:5878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5878:1875463014260096:192.168.201.13@tcp:105: 00010000:00010000:3.0:1788581177.272747:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a707d4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272780:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a707d4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272824:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70898 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272844:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70898 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272857:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70898 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272871:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70898 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272877:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70898 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272883:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70898 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272889:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cec00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581177.272893:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70898 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272901:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70898 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272916:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:3.0:1788581177.272920:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581177.272923:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70898 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272936:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70898 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272948:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a7088a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272954:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a7088a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272960:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a7088a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272966:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581177.272969:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a7088a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272975:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a7088a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272984:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:3.0:1788581177.272985:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788581177.272988:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a7088a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.272995:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a7088a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581177.273359:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581177.273571:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995372288 00000100:00100000:0.0:1788581177.273583:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995372288 00000100:00100000:0.0:1788581177.273668:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 31 00000100:00100000:0.0:1788581177.273681:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:10561:x1875462995372288:12345-192.168.201.13@tcp:49:lfs.0 00000100:00100000:0.0:1788581177.273850:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:10561:x1875462995372288:12345-192.168.201.13@tcp:49:lfs.0 Request processed in 170us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581177.273858:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 31 00000040:00080000:1.0:1788581177.274518:0:11735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788581177.274526:0:11735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788581177.275146:0:11735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788581177.275158:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788581177.287135:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581177.287386:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995372544 00000100:00100000:3.0:1788581177.287402:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995372544 00000100:00100000:3.0:1788581177.287494:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 128 00000100:00100000:3.0:1788581177.287506:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:10561:x1875462995372544:12345-192.168.201.13@tcp:58:lfs.0 00000040:00080000:3.0:1788581177.288764:0:5877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788581177.288973:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:10561:x1875462995372544:12345-192.168.201.13@tcp:58:lfs.0 Request processed in 1463us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581177.288985:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 128 00000100:00100000:2.0:1788581177.294627:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:10563:x1875462995372032:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 77298us (77718us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788581177.294647:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 127 00000020:00080000:2.0:1788581177.294658:0:5878:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788581177.331067:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581177.331296:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995372800 00000100:00100000:3.0:1788581177.331313:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995372800 00000100:00100000:3.0:1788581177.331390:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 32 00000100:00100000:3.0:1788581177.331402:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190673ce850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:10563:x1875462995372800:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788581177.332411:0:5879:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788581177.332539:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1788581177.332602:0:5879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a7089f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.332622:0:5879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a7089f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.332635:0:5879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a7089f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.332645:0:5879:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a7089f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.332653:0:5879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a7089f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.332659:0:5879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a7089f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.332682:0:5879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788581177.332828:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190673ce850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+20:10563:x1875462995372800:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 1423us (1777us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788581177.332847:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 32 00000020:00080000:3.0:1788581177.332855:0:5879:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788581177.333460:0:6738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581177.333471:0:6738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a7089f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.333481:0:6738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cec00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581177.333487:0:6738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a7089f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.333497:0:6738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a7089f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.333517:0:6738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff919052341400) 00010000:00010000:0.0:1788581177.333521:0:6738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788581177.333550:0:6738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a7089f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.333557:0:6738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a7089f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.333585:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581177.333587:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581177.333589:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581177.376505:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581177.377066:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995372928 00000100:00100000:2.0:1788581177.377081:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995372928 00000100:00100000:2.0:1788581177.377387:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 129 00000100:00100000:2.0:1788581177.377419:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+20:10565:x1875462995372928:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1788581177.377463:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581177.377495:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a708a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d91d1 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.377696:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.377716:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.377744:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.377765:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a708b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.377773:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a708b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.377781:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a708b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.378101:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a708bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.378907:0:5876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9192 expref: 21 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.378923:0:5876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a708bb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.378999:0:5876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9192 expref: 21 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.379020:0:5876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9192 expref: 21 pid: 5876 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581177.379039:0:5876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5876:1875463014260224:192.168.201.13@tcp:104: 00000100:00100000:2.0:1788581177.379642:0:5876:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c9150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581177.384309:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581177.384736:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995373184 00000100:00100000:3.0:1788581177.384751:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995373184 00000100:00100000:3.0:1788581177.384843:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:3.0:1788581177.384857:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+22:5610:x1875462995373184:12345-192.168.201.13@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788581177.385213:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+23:5610:x1875462995373184:12345-192.168.201.13@tcp:35:ldlm_bl.0 Request processed in 358us (985us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1788581177.385223:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:2.0:1788581177.385578:0:5876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5876:1875463014260224:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581177.385612:0:5876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a708bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581177.394301:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581177.398735:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581177.398978:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995373312 00000100:00100000:3.0:1788581177.398992:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995373312 00010000:00010000:3.0:1788581177.399054:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9192 expref: 23 pid: 5876 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581177.399109:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 59 00000100:00100000:3.0:1788581177.399136:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+23:2374:x1875462995373312:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581177.399168:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581177.399177:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9192 expref: 23 pid: 5876 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.399193:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9192 expref: 23 pid: 5876 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.399223:0:6739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a707c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9192 expref: 23 pid: 5876 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.399297:0:6739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:3.0:1788581177.399304:0:6739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a708bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.399316:0:6739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a708bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.399326:0:6739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a708bb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581177.399364:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581177.399451:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+22:2374:x1875462995373312:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 318us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581177.399459:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 59 00010000:00010000:2.0:1788581177.400937:0:5876:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a708bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.400956:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a708bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581177.401021:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788581177.401027:0:5876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788581177.401055:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a708bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401073:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a708bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401086:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401115:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401150:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401158:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581177.401164:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401172:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401191:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:2.0:1788581177.401194:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581177.401199:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401205:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401221:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a708b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401227:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a708b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401233:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a708b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401238:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581177.401282:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a708b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401289:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a708b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401298:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91905c525600) 00010000:00010000:2.0:1788581177.401300:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581177.401304:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a708b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401311:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a708b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401363:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a708a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91d1 expref: 22 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401379:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a708bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91d1 expref: 21 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581177.401387:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:2.0:1788581177.401389:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581177.401392:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb82e00, rc 0) 00000100:00100000:2.0:1788581177.401481:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+21:10565:x1875462995372928:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 24064us (24992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581177.401489:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 129 00000100:00100000:0.0:1788581177.455816:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014260352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581177.455934:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581177.456745:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014260352 00000100:00100000:1.0:1788581177.456757:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014260352 00000100:00100000:1.0:1788581177.456829:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788581177.456866:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3339:x1875463014260352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581177.456897:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788581177.456982:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3339:x1875463014260352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581177.456990:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788581177.457105:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014260352:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788581178.291405:0:11735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788581178.291419:0:11735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788581178.291472:0:11735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788581178.291479:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788581178.296429:0:11735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11735:1875463014260480:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788581178.296596:0:11735:0:(client.c:2715:ptlrpc_set_wait()) set ffff919049984a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581178.301461:0:11735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11735:1875463014260480:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788581178.301918:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581178.302388:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995373440 00000100:00100000:3.0:1788581178.302400:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995373440 00000100:00100000:3.0:1788581178.302502:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 130 00000100:00100000:3.0:1788581178.302516:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+21:10577:x1875462995373440:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788581178.302565:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788581178.302699:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+21:10577:x1875462995373440:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 185us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581178.302708:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 130 00000100:00100000:3.0:1788581178.308280:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581178.308441:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995373696 00000100:00100000:3.0:1788581178.308459:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995373696 00000100:00100000:3.0:1788581178.308557:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 131 00000100:00100000:3.0:1788581178.308572:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+21:10577:x1875462995373696:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581178.308601:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581178.308631:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a708c2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d91d8 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581178.308809:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a708c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581178.308831:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a708c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581178.308856:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a708c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581178.308873:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788581178.309054:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a708c2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91d8 expref: 24 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581178.309077:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a708c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91d8 expref: 23 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581178.309087:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:3.0:1788581178.309095:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581178.309100:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cee00, rc 0) 00000100:00100000:3.0:1788581178.309191:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+23:10577:x1875462995373696:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 622us (946us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788581178.309199:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 131 00000100:00080000:0.0:1788581178.310947:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581178.317347:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581178.317495:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581178.317536:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995374080 00000100:00100000:2.0:1788581178.317669:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995373952 00000100:00100000:2.0:1788581178.317678:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995373952 00000100:00100000:2.0:1788581178.317763:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 132 00000100:00100000:1.0:1788581178.317766:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995374080 00000100:00100000:2.0:1788581178.317775:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+24:10577:x1875462995373952:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788581178.317811:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:1.0:1788581178.317818:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+24:2374:x1875462995374080:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581178.317831:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581178.317866:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a708c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91d8 expref: 24 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581178.317886:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:1.0:1788581178.317892:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581178.317893:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581178.317965:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+23:2374:x1875462995374080:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 146us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581178.317974:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00010000:00010000:2.0:1788581178.317995:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581178.318009:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581178.318313:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581178.318323:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581178.318331:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581178.318338:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581178.318345:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581178.318354:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581178.318365:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:2.0:1788581178.318368:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788581178.318372:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581178.318392:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a708d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581178.318553:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+23:10577:x1875462995373952:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 779us (1220us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788581178.318560:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 132 00000040:00080000:1.0:1788581178.318873:0:11735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788581178.318878:0:11735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788581178.321918:0:11735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788581178.321941:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788581178.330806:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581178.330895:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995374336 00000100:00100000:3.0:1788581178.330910:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995374336 00000100:00100000:3.0:1788581178.330988:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00100000:3.0:1788581178.331001:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+23:10577:x1875462995374336:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788581178.331496:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+24:10577:x1875462995374336:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 492us (704us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788581178.331507:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 34 00010000:00010000:1.0:1788581178.417342:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788581178.454665:0:12106:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788581178.454677:0:12106:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788581178.454746:0:12106:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788581178.454754:0:12106:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788581178.726926:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581178.727232:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995374592 00000100:00100000:2.0:1788581178.727303:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995374592 00000100:00100000:0.0:1788581178.728017:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 133 00000100:00100000:0.0:1788581178.728043:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+24:10590:x1875462995374592:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1788581178.728104:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581178.728139:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a708de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d91df expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581178.728361:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22e00/0xf54e3944c2a708e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581178.729996:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22e00/0xf54e3944c2a708e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581178.730033:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22e00/0xf54e3944c2a708e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581178.730062:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788581178.730348:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a708de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91df expref: 27 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581178.731073:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22e00/0xf54e3944c2a708e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91df expref: 26 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581178.731090:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:0.0:1788581178.731103:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788581178.731108:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22e00, rc 0) 00000100:00100000:0.0:1788581178.731382:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+26:10590:x1875462995374592:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 3336us (4458us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788581178.731395:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 133 00000100:00100000:1.0:1788581178.746155:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581178.746803:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995374720 00000100:00100000:2.0:1788581178.746820:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995374720 00000100:00100000:2.0:1788581178.746917:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 134 00000100:00100000:2.0:1788581178.746932:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+26:10590:x1875462995374720:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:2.0:1788581178.747032:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a708f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581178.747053:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a708f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581178.747080:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a708f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581178.747377:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a708f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581178.747387:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a708f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581178.747409:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a708f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581178.747435:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581178.747442:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a708f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581178.747451:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a708f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581178.747467:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:2.0:1788581178.747470:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788581178.747477:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a708f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581178.747484:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a708f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581178.747857:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+26:10590:x1875462995374720:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 924us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581178.747867:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 134 00000100:00100000:1.0:1788581178.945813:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581178.953923:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995374848 00000100:00100000:0.0:1788581178.954147:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995374848 00000100:00100000:0.0:1788581178.954276:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:0.0:1788581178.954291:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2375:x1875462995374848:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:0.0:1788581178.954316:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581178.954345:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a708fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d91e6 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788581178.954383:0:10329:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9b9537, atime: 0x6a9b9536, ctime: 0x6a9b9537, blocks: 0xb 00010000:00010000:0.0:1788581178.954412:0:10329:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=395s v=(0 0) 00010000:00010000:0.0:1788581178.954418:0:10329:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581178.954430:0:10329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a708fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91e6 expref: 7 pid: 10329 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581178.954454:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a708fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91e6 expref: 7 pid: 10329 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581178.954492:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22400, rc 0) 00000100:00100000:0.0:1788581178.954956:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2375:x1875462995374848:12345-192.168.201.13@tcp:101:cat.0 Request processed in 666us (9156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581178.954965:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:0.0:1788581178.971811:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581178.972491:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995374976 00000100:00100000:2.0:1788581178.972506:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995374976 00002000:00100000:2.0:1788581178.972568:0:6729:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff919048581f80 x1875462995374976/t0(0) o3->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:534/0 lens 488/0 e 0 to 0 dl 1788581189 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788581178.972580:0:6729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff919048581f80 with x1875462995374976 ext(0->4095) 00002000:00010000:2.0:1788581178.972587:0:6729:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff919048581f80 00000100:00100000:2.0:1788581178.972667:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:2.0:1788581178.972678:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2374:x1875462995374976:12345-192.168.201.13@tcp:3:cat.0 00000100:00100000:2.0:1788581178.973000:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2374:x1875462995374976:12345-192.168.201.13@tcp:3:cat.0 Request processed in 323us (1197us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788581178.973022:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 3 00002000:00100000:2.0:1788581178.973030:0:6729:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff919048581f80 x1875462995374976/t0(0) o3->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:534/0 lens 488/4536 e 0 to 0 dl 1788581189 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788581178.973039:0:6729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff919048581f80 with x1875462995374976 ext(0->4095) 00002000:00010000:2.0:1788581178.973043:0:6729:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff919048581f80 00010000:00010000:0.0:1788581179.439807:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581180.015914:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014260608:0@lo:400:kworker.0 00000100:00100000:1.0:1788581180.015923:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014260736:0@lo:400:kworker.0 00000100:00100000:1.0:1788581180.018161:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.018261:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014261248:0@lo:400:kworker.0 00000100:00100000:1.0:1788581180.018296:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.018351:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014260864:0@lo:400:kworker.0 00000100:00100000:1.0:1788581180.018376:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.018401:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581180.018408:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014260992:0@lo:400:kworker.0 00000100:00100000:1.0:1788581180.018430:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.018466:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014260736 00000100:00100000:1.0:1788581180.018473:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014260736 00000100:00100000:0.0:1788581180.018487:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.018530:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014260864 00000100:00100000:1.0:1788581180.018533:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014260864 00000100:00100000:0.0:1788581180.018533:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014261120:0@lo:400:kworker.0 00000100:00100000:1.0:1788581180.018564:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788581180.018570:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.018573:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014260736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581180.018621:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014261248 00000100:00100000:1.0:1788581180.018625:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014260736:12345-0@lo:400:kworker.0 Request processed in 53us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581180.018625:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014261248 00000100:00100000:1.0:1788581180.018631:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788581180.018649:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014261120 00000100:00100000:1.0:1788581180.018651:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014261120 00000100:00100000:0.0:1788581180.018652:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014260992 00000100:00100000:0.0:1788581180.018654:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014260992 00000100:00100000:1.0:1788581180.018666:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788581180.018670:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788581180.018672:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014260864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581180.018676:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3341:x1875463014261248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581180.018704:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014260864:12345-0@lo:400:kworker.0 Request processed in 32us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581180.018704:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3341:x1875463014261248:12345-0@lo:400:kworker.0 Request processed in 27us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581180.018710:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788581180.018710:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788581180.018723:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788581180.018723:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788581180.018728:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43215c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014260992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581180.018739:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014261120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581180.018756:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43215c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014260992:12345-0@lo:400:kworker.0 Request processed in 28us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581180.018762:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788581180.018769:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014261120:12345-0@lo:400:kworker.0 Request processed in 31us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581180.018774:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1788581180.018790:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581180.018794:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788581180.018796:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581180.018823:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014260992:0@lo:400:kworker.0 00000100:00100000:1.0:1788581180.018834:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014260864:0@lo:400:kworker.0 00000100:00100000:1.0:1788581180.018865:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014261120:0@lo:400:kworker.0 00000100:00100000:1.0:1788581180.018881:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014260736:0@lo:400:kworker.0 00000100:00100000:1.0:1788581180.018890:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014261248:0@lo:400:kworker.0 00000100:00100000:3.0:1788581180.025109:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014260608 00000100:00100000:3.0:1788581180.025130:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014260608 00000100:00100000:3.0:1788581180.025221:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788581180.025233:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014260608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581180.025363:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014260608:12345-0@lo:400:kworker.0 Request processed in 132us (6874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581180.025370:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788581180.026178:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014260608:0@lo:400:kworker.0 00000100:00100000:1.0:1788581180.295448:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581180.296872:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581180.296915:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581180.296937:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581180.296965:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581180.297017:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995375488 00000100:00100000:2.0:1788581180.297032:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995375488 00000100:00100000:2.0:1788581180.297116:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995375360 00000100:00100000:2.0:1788581180.297120:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995375360 00000100:00100000:2.0:1788581180.297146:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 82 00000100:00100000:2.0:1788581180.297156:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995375488:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581180.297238:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995375488:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 83us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581180.297275:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 82 00000100:00100000:2.0:1788581180.297291:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 83 00000100:00100000:2.0:1788581180.297298:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2374:x1875462995375360:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581180.297323:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2374:x1875462995375360:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581180.297329:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 83 00000100:00100000:1.0:1788581180.298761:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995375104 00000100:00100000:1.0:1788581180.298773:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995375104 00000100:00100000:1.0:1788581180.300931:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 295 00000100:00100000:1.0:1788581180.300956:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995375104:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581180.305602:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995375104:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 4647us (8674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581180.305631:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 295 00000100:00080000:1.0:1788581180.305691:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581180.305697:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581180.306774:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995375232 00000100:00100000:0.0:1788581180.306788:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995375232 00000100:00100000:0.0:1788581180.306886:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995375616 00000100:00100000:0.0:1788581180.306890:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995375616 00000100:00100000:0.0:1788581180.306918:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 151 00000100:00100000:0.0:1788581180.306929:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+26:2374:x1875462995375232:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581180.307364:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+26:2374:x1875462995375232:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 435us (11926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581180.307372:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 151 00000100:00100000:0.0:1788581180.307391:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 152 00000100:00100000:0.0:1788581180.307398:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995375616:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581180.307425:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995375616:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 28us (10458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581180.307431:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 152 00000100:00080000:1.0:1788581180.308678:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788581180.467350:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581180.535716:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581180.535739:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014261376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581180.535812:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581180.536162:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014261376 00000100:00100000:1.0:1788581180.536170:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014261376 00000100:00100000:1.0:1788581180.536227:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788581180.536237:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907ba20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3339:x1875463014261376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581180.536296:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581180.536347:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907ba20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3339:x1875463014261376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581180.536353:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788581180.538660:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014261376:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788581181.066387:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:2.0:1788581181.491010:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788581182.126408:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1788581182.126427:0:5899:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1788581182.126526:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:1.0:1788581182.126542:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:3.0:1788581182.126601:0:5899:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff919049984b40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788581182.126607:0:5899:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff919076c36700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff919049984780 00000020:00080000:3.0:1788581182.126610:0:5899:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff919076c36b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff918f425b2400 00000020:00080000:1.0:1788581182.126646:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788581182.126907:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000040:00080000:3.0:1788581182.449684:0:11735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788581182.449693:0:11735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788581182.449769:0:11735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788581182.449776:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788581182.530702:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581182.576653:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014261504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581182.576728:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581182.576804:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014261504 00000100:00100000:2.0:1788581182.576812:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014261504 00000100:00100000:2.0:1788581182.576870:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788581182.576878:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3339:x1875463014261504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581182.576911:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581182.576952:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3339:x1875463014261504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581182.576959:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788581182.577000:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014261504:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788581182.579839:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788581182.663763:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1788581182.663782:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1788581183.535496:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581184.559594:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581184.898588:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581184.898704:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995375744 00000100:00100000:0.0:1788581184.898718:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995375744 00000100:00100000:0.0:1788581184.898806:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 135 00000100:00100000:0.0:1788581184.898819:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:10249:x1875462995375744:12345-192.168.201.13@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788581184.898941:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:10249:x1875462995375744:12345-192.168.201.13@tcp:60:lhsmtool_posix.0 Request processed in 125us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581184.898949:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 135 00000100:00080000:1.0:1788581184.899316:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581184.904181:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581184.907061:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995376000 00000100:00100000:3.0:1788581184.907076:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995376000 00000100:00100000:3.0:1788581184.907211:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 35 00000100:00100000:3.0:1788581184.907222:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:10249:x1875462995376000:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788581184.907637:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+14:10249:x1875462995376000:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 416us (3468us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788581184.907645:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 35 00000100:00100000:2.0:1788581185.138296:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014261888:0@lo:400:kworker.0 00000100:00100000:2.0:1788581185.138381:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581185.138456:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581185.138464:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014262016:0@lo:400:kworker.0 00000100:00100000:2.0:1788581185.138492:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581185.138522:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014261760:0@lo:400:kworker.0 00000100:00100000:2.0:1788581185.138527:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014262016 00000100:00100000:2.0:1788581185.138534:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014262016 00000100:00100000:3.0:1788581185.138553:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581185.138570:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014262272:0@lo:400:kworker.0 00000100:00100000:3.0:1788581185.138589:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581185.138598:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014262272 00000100:00100000:2.0:1788581185.138602:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014262272 00000100:00100000:3.0:1788581185.138607:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788581185.138612:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014261632:0@lo:400:kworker.0 00000100:00100000:2.0:1788581185.138624:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788581185.138633:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014262016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581185.138638:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581185.138657:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3341:1875463014262144:0@lo:400:kworker.0 00000100:00100000:3.0:1788581185.138674:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581185.138683:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014262016:12345-0@lo:400:kworker.0 Request processed in 51us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581185.138690:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788581185.138704:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788581185.138710:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014262272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581185.138714:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014261632 00000100:00100000:3.0:1788581185.138717:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014261632 00000100:00100000:2.0:1788581185.138741:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014262272:12345-0@lo:400:kworker.0 Request processed in 31us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581185.138742:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788581185.138748:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014261632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581185.138752:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788581185.138769:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014261888 00000100:00100000:2.0:1788581185.138772:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014261888 00000100:00100000:3.0:1788581185.138774:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014261632:12345-0@lo:400:kworker.0 Request processed in 27us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581185.138779:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1788581185.138794:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014261760 00000100:00100000:2.0:1788581185.138797:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014261760 00000100:00100000:2.0:1788581185.138806:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014262144 00000100:00100000:2.0:1788581185.138808:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014262144 00000100:00100000:3.0:1788581185.138809:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788581185.138814:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014261888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581185.138820:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788581185.138825:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014261760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581185.138841:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014261888:12345-0@lo:400:kworker.0 Request processed in 26us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581185.138847:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788581185.138847:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014261760:12345-0@lo:400:kworker.0 Request processed in 23us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581185.138853:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788581185.138858:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788581185.138864:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3341:x1875463014262144:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788581185.138874:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581185.138888:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3341:x1875463014262144:12345-0@lo:400:kworker.0 Request processed in 24us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581185.138893:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788581185.139350:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014261632:0@lo:400:kworker.0 00000100:00100000:1.0:1788581185.139365:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3341:1875463014262144:0@lo:400:kworker.0 00000100:00080000:2.0:1788581185.140010:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581185.140015:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581185.140040:0:3338:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788581185.140046:0:3338:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788581185.140067:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014262016:0@lo:400:kworker.0 00000100:00100000:2.0:1788581185.140080:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014261888:0@lo:400:kworker.0 00000100:00100000:1.0:1788581185.140152:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014261760:0@lo:400:kworker.0 00000100:00100000:1.0:1788581185.140161:0:3341:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788581185.140176:0:3341:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91906c7e0a80, transno 4294967304 00000100:00100000:1.0:1788581185.140198:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014262272:0@lo:400:kworker.0 00000100:00100000:2.0:1788581185.179815:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581185.179969:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995376128 00000100:00100000:0.0:1788581185.180002:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995376128 00000100:00100000:0.0:1788581185.180087:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 136 00000100:00100000:0.0:1788581185.180098:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:11044:x1875462995376128:12345-192.168.201.13@tcp:101:lsof.0 00010000:00010000:0.0:1788581185.180119:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581185.180141:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70901 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d91ed expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581185.180221:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70908 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581185.180238:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70908 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581185.180296:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70908 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581185.180340:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788581185.180343:0:9658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788581185.180386:0:9658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70908 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581185.180411:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70901 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ed expref: 7 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581185.180430:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70908 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ed expref: 6 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581185.180438:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525000) 00000100:00080000:2.0:1788581185.180540:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788581185.180628:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581185.180633:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22800, rc 0) 00000100:00100000:0.0:1788581185.180704:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:11044:x1875462995376128:12345-192.168.201.13@tcp:101:lsof.0 Request processed in 607us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581185.180712:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 136 00000100:00100000:2.0:1788581185.413812:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581185.413870:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581185.413910:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581185.414136:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995376512 00000100:00100000:0.0:1788581185.414151:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995376512 00000100:00100000:0.0:1788581185.414286:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995376384 00000100:00100000:0.0:1788581185.414290:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995376384 00000100:00100000:0.0:1788581185.414321:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 86 00000100:00100000:0.0:1788581185.414331:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2373:x1875462995376512:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581185.414437:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2373:x1875462995376512:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 107us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581185.414446:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 86 00000100:00100000:0.0:1788581185.414466:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 87 00000100:00100000:0.0:1788581185.414473:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2373:x1875462995376384:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581185.414499:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2373:x1875462995376384:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 27us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581185.414505:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 87 00000100:00100000:1.0:1788581185.414896:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995376256 00000100:00100000:1.0:1788581185.414902:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995376256 00000100:00100000:1.0:1788581185.414946:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 297 00000100:00100000:1.0:1788581185.414955:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2373:x1875462995376256:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581185.415019:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2373:x1875462995376256:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 65us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581185.415026:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 297 00000100:00080000:2.0:1788581185.416460:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788581185.416470:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788581185.587162:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581185.647580:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581185.647605:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43214e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014262400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581185.647679:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581185.648215:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014262400 00000100:00100000:1.0:1788581185.648227:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014262400 00000100:00100000:1.0:1788581185.648319:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788581185.648331:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014262400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581185.648370:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581185.648449:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014262400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581185.648456:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788581185.648519:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43214e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014262400:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788581186.607789:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788581187.256936:0:5899:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:3.0:1788581187.256972:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788581187.257014:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788581187.257024:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788581187.634566:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581187.702088:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014262528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581187.702171:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581187.702461:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014262528 00000100:00100000:2.0:1788581187.702483:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014262528 00000100:00100000:2.0:1788581187.702553:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788581187.702563:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014262528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581187.702599:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581187.702647:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014262528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581187.702653:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1788581187.705236:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581187.705477:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014262528:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788581188.662493:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788581188.974573:0:12307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 00:06:27 (1788581187) 00010000:00010000:0.0:1788581189.679562:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581190.255602:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014262656:0@lo:400:kworker.0 00000100:00100000:2.0:1788581190.255699:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581190.255771:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014263168:0@lo:400:kworker.0 00000100:00100000:2.0:1788581190.255801:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581190.255825:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788581190.255830:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014262784:0@lo:400:kworker.0 00000100:00100000:2.0:1788581190.255853:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581190.255868:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43217800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014263296:0@lo:400:kworker.0 00000100:00100000:2.0:1788581190.255890:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581190.256176:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014262656 00000100:00100000:1.0:1788581190.256188:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014262656 00000100:00100000:1.0:1788581190.256300:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788581190.256312:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014262656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581190.256369:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014262656:12345-0@lo:400:kworker.0 Request processed in 59us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581190.256392:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788581190.256564:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014262656:0@lo:400:kworker.0 00000100:00100000:0.0:1788581190.256582:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014262912:0@lo:400:kworker.0 00000100:00100000:2.0:1788581190.256601:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014263168 00000100:00100000:2.0:1788581190.256605:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014263168 00000100:00100000:0.0:1788581190.256613:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581190.256645:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581190.256651:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014263040:0@lo:400:kworker.0 00000100:00100000:0.0:1788581190.256687:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581190.256719:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014263296 00000100:00100000:0.0:1788581190.256723:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014263296 00000100:00100000:0.0:1788581190.256752:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014263040 00000100:00100000:0.0:1788581190.256756:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014263040 00000100:00100000:0.0:1788581190.256777:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788581190.256783:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014263296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581190.256824:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014263296:12345-0@lo:400:kworker.0 Request processed in 41us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581190.256831:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788581190.256844:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1788581190.256848:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581190.256850:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014263040:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788581190.256852:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788581190.256855:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581190.256883:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014262784 00000100:00100000:2.0:1788581190.256888:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014262784 00000100:00100000:0.0:1788581190.256896:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014263040:12345-0@lo:400:kworker.0 Request processed in 47us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581190.256912:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788581190.256957:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014263040:0@lo:400:kworker.0 00000100:00100000:1.0:1788581190.262995:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014262912 00000100:00100000:1.0:1788581190.263012:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014262912 00000100:00100000:1.0:1788581190.263090:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788581190.263100:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014263168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581190.263197:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014263168:12345-0@lo:400:kworker.0 Request processed in 98us (7395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581190.263204:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788581190.263221:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788581190.263227:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014262784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581190.263275:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014262784:12345-0@lo:400:kworker.0 Request processed in 48us (7421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581190.263281:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788581190.263294:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788581190.263300:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014262912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581190.263339:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014262912:12345-0@lo:400:kworker.0 Request processed in 40us (6725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581190.263345:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:1.0:1788581190.263371:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581190.263421:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014262912:0@lo:400:kworker.0 00000100:00100000:1.0:1788581190.263477:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014262784:0@lo:400:kworker.0 00000100:00100000:1.0:1788581190.263492:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43217800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014263296:0@lo:400:kworker.0 00000100:00100000:1.0:1788581190.263522:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014263168:0@lo:400:kworker.0 00000100:00100000:2.0:1788581190.536807:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581190.536860:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581190.536908:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581190.536942:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581190.536987:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581190.537021:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995376896 00000100:00100000:2.0:1788581190.537031:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995376896 00000100:00100000:2.0:1788581190.537088:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995377024 00000100:00100000:2.0:1788581190.537092:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995377024 00000100:00100000:2.0:1788581190.537116:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 90 00000100:00100000:2.0:1788581190.537125:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2372:x1875462995376896:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581190.537190:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2372:x1875462995376896:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 66us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581190.537198:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 90 00000100:00100000:2.0:1788581190.537212:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 91 00000100:00100000:2.0:1788581190.537218:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2372:x1875462995377024:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581190.537238:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2372:x1875462995377024:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 20us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581190.537272:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 91 00000100:00080000:2.0:1788581190.537377:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581190.537381:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581190.537514:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995377152 00000100:00100000:1.0:1788581190.537519:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995377152 00000100:00100000:1.0:1788581190.537558:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995376768 00000100:00100000:1.0:1788581190.537561:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995376768 00000100:00100000:1.0:1788581190.537577:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 159 00000100:00100000:1.0:1788581190.537583:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:2372:x1875462995377152:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581190.537627:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:2372:x1875462995377152:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 44us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581190.537634:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 159 00000100:00100000:1.0:1788581190.537647:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 160 00000100:00100000:1.0:1788581190.537652:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:2372:x1875462995376768:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581190.537674:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:2372:x1875462995376768:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 22us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581190.537679:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 160 00000100:00100000:0.0:1788581190.537775:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995376640 00000100:00100000:0.0:1788581190.537780:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995376640 00000100:00100000:0.0:1788581190.537812:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 299 00000100:00100000:0.0:1788581190.537818:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2372:x1875462995376640:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581190.537856:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2372:x1875462995376640:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 29us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581190.537875:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 299 00000100:00080000:2.0:1788581190.538358:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581190.683961:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581190.684132:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995377408 00000100:00100000:3.0:1788581190.684148:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995377408 00000100:00100000:3.0:1788581190.684235:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 137 00000100:00100000:3.0:1788581190.684284:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:11309:x1875462995377408:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581190.684342:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581190.684382:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a7090f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d91f4 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.684484:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70916 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.684502:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70916 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.684518:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70916 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.684536:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a7091d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.684542:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a7091d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.684548:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a7091d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.686265:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70924 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.686290:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70924 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.686301:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70924 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581190.686889:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788581190.687144:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70916 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.687153:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70916 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.687161:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70916 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.687168:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cfa00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581190.687173:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70916 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.687181:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70916 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.687199:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff919052341700) 00010000:00010000:3.0:1788581190.687203:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581190.687209:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70916 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.687214:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70916 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.687230:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a7091d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.687236:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a7091d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.688483:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a7091d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.688513:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581190.688517:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a7091d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.688525:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a7091d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.688539:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff919052341100) 00010000:00010000:3.0:1788581190.688542:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581190.688545:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a7091d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.688552:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a7091d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.689313:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a7090f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91f4 expref: 16 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.689336:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70924 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91f4 expref: 15 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581190.689345:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91904995af00) 00010000:00010000:3.0:1788581190.689348:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581190.689351:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf200, rc 0) 00000100:00100000:3.0:1788581190.689467:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+15:11309:x1875462995377408:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 5184us (5521us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788581190.689477:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 137 00000100:00100000:2.0:1788581190.699946:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581190.700064:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995377536 00000100:00100000:1.0:1788581190.700082:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995377536 00000100:00100000:1.0:1788581190.700179:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:1.0:1788581190.700191:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049af1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+15:2373:x1875462995377536:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581190.700209:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581190.700237:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70924 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91f4 expref: 15 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581190.700287:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91904995af00) 00010000:00010000:1.0:1788581190.700293:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581190.700385:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049af1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+14:2373:x1875462995377536:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 193us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581190.700395:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00010000:00010000:2.0:1788581190.705590:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581190.711482:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581190.711688:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995377664 00000100:00100000:2.0:1788581190.711699:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995377664 00000100:00100000:2.0:1788581190.711806:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 138 00000100:00100000:2.0:1788581190.711816:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+14:11309:x1875462995377664:12345-192.168.201.13@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788581190.715964:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+14:11309:x1875462995377664:12345-192.168.201.13@tcp:59:lhsmtool_posix.0 Request processed in 4136us (4479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581190.715995:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 138 00000100:00100000:2.0:1788581190.767719:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581190.767745:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43217800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014263424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581190.767826:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581190.768016:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014263424 00000100:00100000:1.0:1788581190.768025:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014263424 00000100:00100000:1.0:1788581190.768085:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788581190.768095:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014263424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581190.768131:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581190.768178:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014263424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581190.768185:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788581190.768351:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43217800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014263424:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788581191.664325:0:11735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788581191.664337:0:11735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788581191.664858:0:11735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788581191.664867:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788581191.727446:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788581192.386127:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:0.0:1788581192.688076:0:11735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788581192.688085:0:11735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788581192.693099:0:11735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788581192.693115:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788581192.753094:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581192.817012:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581192.817040:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014263552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581192.817121:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581192.817758:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014263552 00000100:00100000:0.0:1788581192.817771:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014263552 00000100:00100000:0.0:1788581192.817849:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788581192.817869:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43214380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014263552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581192.817916:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581192.817996:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43214380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014263552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581192.818004:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788581192.818060:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014263552:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788581192.819763:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581192.986410:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581192.989510:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995377792 00000100:00100000:1.0:1788581192.989527:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995377792 00000100:00100000:1.0:1788581192.989605:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 139 00000100:00100000:1.0:1788581192.989619:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:11351:x1875462995377792:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1788581192.989642:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581192.989664:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70932 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d91fb expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.989729:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70939 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.989754:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70939 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.989767:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70939 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.989782:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70940 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.989789:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70940 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.989796:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70940 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.990024:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70939 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.990032:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70939 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.990039:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70939 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.990045:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581192.990050:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70939 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.990058:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70939 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.990070:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525000) 00010000:00010000:1.0:1788581192.990078:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581192.990083:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70939 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.990089:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70939 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.990102:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70940 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.990108:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70940 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.990114:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70940 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.990120:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9c00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581192.990123:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70940 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.990129:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70940 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.990136:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91905c6f1000) 00010000:00010000:1.0:1788581192.990139:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581192.990142:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70940 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.990147:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70940 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.990179:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70932 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91fb expref: 14 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.990199:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525000) 00010000:00010000:1.0:1788581192.990202:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581192.990206:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70932 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91fb expref: 14 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581192.990215:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8400, rc 0) 00000100:00100000:1.0:1788581192.991478:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:11351:x1875462995377792:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1856us (5072us total) trans 0 rc 301/301 00000100:00100000:1.0:1788581192.991488:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 139 00000100:00080000:3.0:1788581192.994112:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581193.004090:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581193.004164:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995378048 00000100:00100000:1.0:1788581193.004174:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995378048 00000100:00100000:1.0:1788581193.004230:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 140 00000100:00100000:1.0:1788581193.004290:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:11351:x1875462995378048:12345-192.168.201.13@tcp:36:lfs.0 00010000:00010000:1.0:1788581193.004348:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581193.004375:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a702b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9034 expref: 13 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.004392:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525000) 00010000:00010000:1.0:1788581193.004397:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581193.004623:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70947 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.004639:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70908 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ed expref: 5 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.004649:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70947 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.004692:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70908 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ed expref: 5 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.004705:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70908 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ed expref: 5 pid: 9658 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581193.004718:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43215180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5877:1875463014263680:192.168.201.13@tcp:104: 00000100:00100000:1.0:1788581193.004804:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906148d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581193.007636:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43215180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5877:1875463014263680:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581193.007666:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70947 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581193.009101:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581193.009293:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995378176 00000100:00100000:1.0:1788581193.009304:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995378176 00010000:00010000:1.0:1788581193.009354:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70908 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ed expref: 6 pid: 9658 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581193.009392:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 60 00000100:00100000:1.0:1788581193.009403:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:2374:x1875462995378176:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581193.009418:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581193.009425:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70908 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ed expref: 6 pid: 9658 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.009448:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70908 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ed expref: 6 pid: 9658 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.009469:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70908 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91ed expref: 6 pid: 9658 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.009484:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525000) 00010000:00010000:1.0:1788581193.009503:0:5863:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70947 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.009512:0:5863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70947 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.009519:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70947 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.009544:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581193.009592:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995378176:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 192us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581193.009600:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 60 00010000:00010000:2.0:1788581193.009718:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70947 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.009726:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70947 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.009750:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7094e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.009760:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7094e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.009767:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7094e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788581193.010413:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788581193.012787:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788581193.012807:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70947 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.012831:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70947 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.012838:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70947 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.012844:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581193.012849:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70947 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.012869:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70947 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.012885:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c525000) 00010000:00010000:2.0:1788581193.012888:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581193.012893:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70947 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.012900:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70947 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581193.012919:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000870cd822 reply state 000000006487e9b0 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7094e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581193.012927:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788581193.013027:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+14:11351:x1875462995378048:12345-192.168.201.13@tcp:36:lfs.0 Request processed in 8783us (8941us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788581193.013036:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 140 00010000:00010000:3.0:1788581193.022198:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7094e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.022220:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7094e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.022229:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7094e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.022235:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb82a00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581193.022279:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7094e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.022288:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7094e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.022307:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91905c525200) 00010000:00010000:3.0:1788581193.022310:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581193.022316:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7094e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.022322:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a7094e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581193.180344:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581193.180909:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995378304 00000100:00100000:1.0:1788581193.180920:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995378304 00000100:00100000:1.0:1788581193.180980:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 141 00000100:00100000:1.0:1788581193.180990:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:11359:x1875462995378304:12345-192.168.201.13@tcp:101:lctl.0 00010000:00010000:1.0:1788581193.181012:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581193.181036:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70955 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9202 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.181103:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a7095c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.181117:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a7095c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.181129:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a7095c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581193.181167:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788581193.181187:0:5878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788581193.181213:0:5878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a7095c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.181274:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70955 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9202 expref: 15 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.181295:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a7095c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9202 expref: 14 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.181304:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c6f1000) 00010000:00010000:1.0:1788581193.181307:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581193.181309:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9000, rc 0) 00000100:00100000:1.0:1788581193.181381:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+14:11359:x1875462995378304:12345-192.168.201.13@tcp:101:lctl.0 Request processed in 392us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581193.181388:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 141 00000100:00100000:0.0:1788581193.254325:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581193.254489:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995378432 00000100:00100000:2.0:1788581193.254500:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995378432 00000100:00100000:2.0:1788581193.254585:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 142 00000100:00100000:2.0:1788581193.254595:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+14:11365:x1875462995378432:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:2.0:1788581193.254615:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581193.254636:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70963 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9209 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.254701:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7096a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.254714:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7096a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.254725:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7096a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.254739:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70971 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.254745:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.254751:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.254845:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70978 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.254863:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.254870:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581193.254908:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788581193.254911:0:5876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788581193.254930:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.254941:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7096a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.254948:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7096a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.254954:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7096a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.254960:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581193.254964:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7096a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.254972:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7096a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.254984:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c6f1000) 00010000:00010000:2.0:1788581193.254987:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581193.254992:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7096a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.254999:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a7096a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.255013:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.255030:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70971 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.255036:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70971 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.255041:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581193.255044:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70971 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.255050:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70971 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.255058:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91905c525000) 00010000:00010000:2.0:1788581193.255060:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581193.255063:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70971 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.255069:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70971 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.255100:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70963 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9209 expref: 16 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.255114:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70978 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9209 expref: 15 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.255121:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:2.0:1788581193.255123:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788581193.255131:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb82200, rc 0) 00000100:00100000:2.0:1788581193.255200:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+15:11365:x1875462995378432:12345-192.168.201.13@tcp:101:bash.0 Request processed in 606us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581193.255208:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 142 00000100:00100000:2.0:1788581193.260069:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581193.260172:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995378688 00000100:00100000:1.0:1788581193.260183:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995378688 00000100:00100000:1.0:1788581193.260299:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 143 00000100:00100000:1.0:1788581193.260309:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+15:11365:x1875462995378688:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:1.0:1788581193.260330:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581193.260351:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a7097f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9210 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.260487:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70986 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.260501:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70986 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.260530:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70986 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.260584:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7098d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.260592:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7098d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.260598:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7098d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788581193.261138:0:5878:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788581193.261338:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70994 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.261347:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.261355:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.261388:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70986 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.261395:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70986 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.261401:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70986 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.261408:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581193.261420:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70986 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.261427:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70986 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.261439:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:1.0:1788581193.261442:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581193.261446:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70986 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.261452:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70986 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788581193.261464:0:5878:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084086685 reply state 000000007c0d0094 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7098d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581193.261472:0:5878:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788581193.261503:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a7097f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9210 expref: 18 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.261515:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9210 expref: 17 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.261522:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c6f1f00) 00010000:00010000:1.0:1788581193.261524:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581193.261526:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9e00, rc 0) 00000100:00100000:1.0:1788581193.261594:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:11365:x1875462995378688:12345-192.168.201.13@tcp:101:bash.0 Request processed in 1287us (1536us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788581193.261601:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 143 00010000:00010000:2.0:1788581193.266516:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7098d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.266534:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7098d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.266540:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7098d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.266546:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581193.266552:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7098d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.266559:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7098d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.266577:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91905c6f1600) 00010000:00010000:2.0:1788581193.266580:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581193.266584:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7098d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.266589:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7098d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581193.267823:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581193.267920:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995378816 00000100:00100000:0.0:1788581193.267931:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995378816 00000100:00100000:0.0:1788581193.268004:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 47 00000100:00100000:0.0:1788581193.268016:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995378816:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:0.0:1788581193.268034:0:6722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581193.268055:0:6722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a709a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9217 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788581193.268098:0:6722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581193.268118:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1788581193.268123:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581193.268133:0:6722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a709a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9217 expref: 6 pid: 6722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581193.268153:0:6722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a709a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9217 expref: 6 pid: 6722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581193.268168:0:6722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22600, rc 0) 00000100:00100000:0.0:1788581193.268233:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995378816:12345-192.168.201.13@tcp:101:bash.0 Request processed in 218us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581193.268273:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 47 00000100:00080000:3.0:1788581193.268626:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581193.273226:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581193.273400:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995378944 00000100:00100000:2.0:1788581193.273418:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995378944 00000100:00100000:2.0:1788581193.273492:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:2.0:1788581193.273504:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:11365:x1875462995378944:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:2.0:1788581193.273523:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581193.273543:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a709a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d921e expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.273576:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a709a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9217 expref: 7 pid: 6722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.273585:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581193.273589:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581193.273595:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a709a9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d921e expref: 7 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.273630:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a709a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9217 expref: 7 pid: 6722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.273645:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a709a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9217 expref: 7 pid: 6722 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581193.273659:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076886680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6725:1875463014263808:192.168.201.13@tcp:104: 00000100:00100000:2.0:1788581193.273751:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907b909300 going to sleep for 11 seconds 00000100:00100000:1.0:1788581193.277887:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581193.278061:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076886680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6725:1875463014263808:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581193.278097:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a709a9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d921e expref: 7 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.278142:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb83800, rc 0) 00000100:00100000:2.0:1788581193.278215:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:11365:x1875462995378944:12345-192.168.201.13@tcp:101:bash.0 Request processed in 4712us (5000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581193.278225:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:3.0:1788581193.280142:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995379072 00000100:00100000:3.0:1788581193.280156:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995379072 00010000:00010000:3.0:1788581193.280205:0:5862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a709a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9217 expref: 7 pid: 6722 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581193.280368:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 61 00000100:00100000:2.0:1788581193.280381:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43215f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2375:x1875462995379072:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581193.280396:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581193.280421:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a709a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9217 expref: 7 pid: 6722 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.280674:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a709a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9217 expref: 7 pid: 6722 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.280697:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a709a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9217 expref: 7 pid: 6722 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.280714:0:5861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581193.280719:0:5861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581193.280727:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a709a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d921e expref: 6 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.280737:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a709a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d921e expref: 6 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.280798:0:5861:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a709a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d921e expref: 6 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581193.280812:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076886680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5861:1875463014263936:192.168.201.13@tcp:105: 00000100:00100000:2.0:1788581193.281051:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907b909300 going to sleep for 11 seconds 00000100:00100000:2.0:1788581193.285720:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076886680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5861:1875463014263936:192.168.201.13@tcp:105: 00010000:00010000:2.0:1788581193.285745:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581193.285798:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43215f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2375:x1875462995379072:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 5419us (7930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581193.285811:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 61 00000100:00100000:1.0:1788581193.287661:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581193.287798:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995379328 00000100:00100000:3.0:1788581193.287808:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995379328 00000100:00100000:3.0:1788581193.287871:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00100000:3.0:1788581193.287891:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+17:11365:x1875462995379328:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:3.0:1788581193.288287:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:11365:x1875462995379328:12345-192.168.201.13@tcp:35:bash.0 Request processed in 397us (633us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788581193.288296:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00100000:0.0:1788581193.424180:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581193.424513:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995379584 00000100:00100000:2.0:1788581193.424524:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995379584 00000100:00100000:2.0:1788581193.424639:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 144 00000100:00100000:2.0:1788581193.424650:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:11375:x1875462995379584:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1788581193.424674:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581193.424695:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a709b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9225 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581193.424796:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788581193.424938:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a709b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9225 expref: 20 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.424953:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c6f1000) 00010000:00010000:2.0:1788581193.424957:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788581193.424975:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a709b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9225 expref: 20 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.424989:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb83000, rc 0) 00000100:00100000:2.0:1788581193.425190:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:11375:x1875462995379584:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 541us (1020us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788581193.425198:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 144 00000100:00100000:0.0:1788581193.430698:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581193.431092:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995379840 00000100:00100000:3.0:1788581193.431103:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995379840 00000100:00100000:3.0:1788581193.431164:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:3.0:1788581193.431176:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:11375:x1875462995379840:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:3.0:1788581193.431705:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+20:11375:x1875462995379840:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 529us (1015us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788581193.431714:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:0.0:1788581193.555357:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581193.555514:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995379968 00000100:00100000:1.0:1788581193.555527:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995379968 00000100:00100000:1.0:1788581193.555594:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 145 00000100:00100000:1.0:1788581193.555605:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+20:11381:x1875462995379968:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1788581193.555633:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581193.555653:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a709be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d922c expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.555728:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a709c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.555743:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a709c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.555768:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a709c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581193.555804:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788581193.555807:0:5878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788581193.555824:0:5878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a709c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.556051:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a709be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d922c expref: 22 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.556076:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a709c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d922c expref: 21 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.556104:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:1.0:1788581193.556106:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581193.556110:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8000, rc 0) 00000100:00100000:1.0:1788581193.556220:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+21:11381:x1875462995379968:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 616us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581193.556228:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 145 00000100:00100000:0.0:1788581193.568738:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581193.568979:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995380224 00000100:00100000:2.0:1788581193.568991:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995380224 00000100:00100000:2.0:1788581193.569069:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 146 00000100:00100000:2.0:1788581193.569084:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+21:11381:x1875462995380224:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1788581193.569108:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581193.569131:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a709cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9233 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.569521:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a709d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.569536:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a709d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.569548:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a709d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581193.569560:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788581193.569694:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a709cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9233 expref: 24 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.569711:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a709d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9233 expref: 23 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.569733:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c6f1f00) 00010000:00010000:2.0:1788581193.569736:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581193.569739:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb83200, rc 0) 00000100:00100000:2.0:1788581193.569957:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+23:11381:x1875462995380224:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 876us (1227us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788581193.569964:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 146 00000100:00100000:0.0:1788581193.577317:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581193.577460:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995380352 00000100:00100000:1.0:1788581193.577470:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995380352 00000100:00100000:1.0:1788581193.577533:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:1.0:1788581193.577544:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+23:2372:x1875462995380352:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581193.577561:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581193.577585:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a709d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9233 expref: 23 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.577605:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c6f1f00) 00010000:00010000:1.0:1788581193.577610:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581193.577667:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+22:2372:x1875462995380352:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 125us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581193.577674:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:0.0:1788581193.581015:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581193.581104:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995380608 00000100:00100000:3.0:1788581193.581114:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995380608 00000100:00100000:3.0:1788581193.581174:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 147 00000100:00100000:3.0:1788581193.581185:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+22:11381:x1875462995380608:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581193.581210:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581193.581232:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a709e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d923a expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.581386:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a709e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.581401:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a709e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.581412:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a709e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581193.581424:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788581193.581546:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a709e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d923a expref: 25 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.581564:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a709e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d923a expref: 24 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.581574:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c6f1f00) 00010000:00010000:3.0:1788581193.581577:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788581193.581580:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf000, rc 0) 00000100:00100000:3.0:1788581193.581632:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+24:11381:x1875462995380608:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 449us (626us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788581193.581640:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 147 00000100:00100000:0.0:1788581193.592859:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581193.593021:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995380736 00000100:00100000:2.0:1788581193.593032:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995380736 00000100:00100000:2.0:1788581193.593092:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:2.0:1788581193.593103:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2375:x1875462995380736:12345-192.168.201.13@tcp:1:lfs.0 00010000:00010000:2.0:1788581193.593152:0:6722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab077389/0xf54e3944c2a709f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.593173:0:6722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a709a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d921e expref: 6 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.593182:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581193.593186:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581193.593191:0:6722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab077389/0xf54e3944c2a709f6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.593288:0:6722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a709a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d921e expref: 6 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.593304:0:6722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a709a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d921e expref: 6 pid: 6725 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581193.593337:0:6722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076886680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6722:1875463014264064:192.168.201.13@tcp:104: 00000100:00100000:2.0:1788581193.593422:0:6722:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907b909300 going to sleep for 11 seconds 00000100:00100000:2.0:1788581193.608657:0:6722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076886680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6722:1875463014264064:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581193.608692:0:6722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ab077389/0xf54e3944c2a709f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581193.609514:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581193.610039:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995380864 00000100:00100000:1.0:1788581193.610050:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995380864 00002000:00100000:1.0:1788581193.610108:0:6728:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff919047c58e00 x1875462995380864/t0(0) o4->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:549/0 lens 504/0 e 0 to 0 dl 1788581204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788581193.610118:0:6728:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff919047c58e00 with x1875462995380864 ext(0->12) 00010000:00010000:1.0:1788581193.610129:0:6728:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a709a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d921e expref: 7 pid: 6725 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581193.610165:0:6728:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a709a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d921e expref: 7 pid: 6725 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788581193.610173:0:6728:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff919047c58e00 00000100:00100000:2.0:1788581193.610370:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:2.0:1788581193.610383:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2375:x1875462995380864:12345-192.168.201.13@tcp:4:lfs.0 00000100:00100000:2.0:1788581193.611011:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:2375:x1875462995380864:12345-192.168.201.13@tcp:4:lfs.0 Request processed in 629us (1497us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788581193.611021:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 2 00002000:00100000:2.0:1788581193.611030:0:6729:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff919047c58e00 x1875462995380864/t4294967305(0) o4->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:549/0 lens 504/448 e 0 to 0 dl 1788581204 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788581193.611040:0:6729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff919047c58e00 with x1875462995380864 ext(0->12) 00010000:00010000:2.0:1788581193.611048:0:6729:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a709a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d921e expref: 9 pid: 6725 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.611063:0:6729:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a709a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d921e expref: 9 pid: 6725 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788581193.611071:0:6729:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff919047c58e00 00000100:00100000:0.0:1788581193.615619:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581193.615721:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995380992 00000100:00100000:3.0:1788581193.615731:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995380992 00010000:00010000:3.0:1788581193.615775:0:5862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a709a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d921e expref: 9 pid: 6725 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581193.615822:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 62 00000100:00100000:3.0:1788581193.615855:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:2373:x1875462995380992:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581193.615878:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788581193.615899:0:5862:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788581193.615902:0:5862:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788581192 00002000:00010000:3.0:1788581193.615905:0:5862:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788581193 00002000:00010000:3.0:1788581193.615906:0:5862:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788581192 00010000:00010000:3.0:1788581193.615913:0:5862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a709a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d921e expref: 9 pid: 6725 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.615927:0:5862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a709a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d921e expref: 9 pid: 6725 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.615952:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007e2f959/0xf54e3944c2a709a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d921e expref: 9 pid: 6725 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.615969:0:5862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581193.615974:0:5862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581193.615980:0:5862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab077389/0xf54e3944c2a709f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.615989:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab077389/0xf54e3944c2a709f6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.616028:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581193.616090:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2373:x1875462995380992:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 247us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581193.616098:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 62 00010000:00010000:0.0:1788581193.616567:0:6722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ab077389/0xf54e3944c2a709f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581193.616591:0:6722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab077389/0xf54e3944c2a709f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581193.616616:0:6722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab077389/0xf54e3944c2a709f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581193.616625:0:6722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab077389/0xf54e3944c2a709f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581193.616633:0:6722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab077389/0xf54e3944c2a709f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581193.616640:0:6722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83000 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581193.616644:0:6722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab077389/0xf54e3944c2a709f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581193.616654:0:6722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab077389/0xf54e3944c2a709f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581193.616667:0:6722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab077389/0xf54e3944c2a709f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581193.616674:0:6722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab077389/0xf54e3944c2a709f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581193.616736:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2375:x1875462995380736:12345-192.168.201.13@tcp:1:lfs.0 Request processed in 23635us (23898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581193.616745:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:0.0:1788581193.621772:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581193.621979:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995381248 00000100:00100000:3.0:1788581193.621990:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995381248 00000100:00100000:3.0:1788581193.622058:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 38 00000100:00100000:3.0:1788581193.622070:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190673ce450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+24:11381:x1875462995381248:12345-192.168.201.13@tcp:35:lfs.0 00000004:00010000:3.0:1788581193.622141:0:5879:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a709e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d923a expref: 24 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788581193.626618:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1788581193.626764:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788581193.628783:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788581193.628881:0:5879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a709fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.628903:0:5879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70994 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9210 expref: 28 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.628912:0:5879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a709fd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.628955:0:5879:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9210 expref: 28 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581193.628970:0:5879:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9210 expref: 28 pid: 5878 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581193.628986:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076886680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5879:1875463014264192:192.168.201.13@tcp:104: 00000100:00100000:2.0:1788581193.629132:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907b909300 going to sleep for 11 seconds 00000100:00100000:1.0:1788581193.636909:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581193.637034:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076886680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5879:1875463014264192:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581193.637062:0:5879:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a709fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581193.637306:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995381376 00000100:00100000:3.0:1788581193.637314:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995381376 00010000:00010000:3.0:1788581193.637352:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9210 expref: 29 pid: 5878 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581193.637391:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 63 00000100:00100000:3.0:1788581193.637400:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43217800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+29:2375:x1875462995381376:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581193.637414:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581193.637422:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9210 expref: 29 pid: 5878 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.637434:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9210 expref: 29 pid: 5878 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.637456:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70994 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9210 expref: 29 pid: 5878 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.637472:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c6f1f00) 00010000:00010000:3.0:1788581193.637477:0:5863:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a709fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.637500:0:5863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a709fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.637507:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a709fd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.637528:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581193.637583:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43217800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+28:2375:x1875462995381376:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 183us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581193.637590:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 63 00010000:00010000:0.0:1788581193.637662:0:5879:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a709fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581193.637669:0:5879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a709fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788581193.637791:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788581193.638021:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788581193.638132:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919047c58380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5879:1875463014264320:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788581193.638182:0:5879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581193.638234:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f4357f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788581193.638809:0:5881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014264320 00000100:00100000:3.0:1788581193.638817:0:5881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014264320 00000100:00100000:3.0:1788581193.638885:0:5881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581193.638896:0:5881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5879:x1875463014264320:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788581193.638987:0:5881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5879:x1875463014264320:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 93us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581193.638994:0:5881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788581193.639506:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581193.639554:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919047c58380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5879:1875463014264320:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788581193.640207:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788581193.641520:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919047c58380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5879:1875463014264448:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788581193.641595:0:5879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581193.641647:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f4357fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581193.641816:0:5881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014264448 00000100:00100000:3.0:1788581193.641825:0:5881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014264448 00000100:00100000:3.0:1788581193.641969:0:5881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788581193.641980:0:5881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5879:x1875463014264448:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788581193.642214:0:5881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5879:x1875463014264448:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 236us (618us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788581193.642222:0:5881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788581193.642321:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919047c58380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5879:1875463014264448:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788581193.642392:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788581193.642433:0:5879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a709fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581193.642459:0:5879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a709fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581193.642467:0:5879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a709fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581193.642473:0:5879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581193.642478:0:5879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a709fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581193.642486:0:5879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a709fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581193.642505:0:5879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c6f1f00) 00010000:00010000:0.0:1788581193.642508:0:5879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788581193.642514:0:5879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a709fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581193.642520:0:5879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a709fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788581193.642702:0:5879:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788581193.642859:0:5879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1788581193.642870:0:5879:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 409883626104ns, next at 410883624143ns, rc = 0 00000001:00080000:0.0:1788581193.642877:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788581193.642909:0:5879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c6f1f00) 00010000:00010000:0.0:1788581193.642912:0:5879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788581193.642920:0:5879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a709e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d923a expref: 32 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581193.643060:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190673ce450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+31:11381:x1875462995381248:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 20991us (21298us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788581193.643068:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 38 00000020:00080000:0.0:1788581193.643072:0:5879:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788581193.653219:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581193.654538:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995381504 00000100:00100000:3.0:1788581193.654553:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995381504 00000100:00100000:3.0:1788581193.654627:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 148 00000100:00100000:3.0:1788581193.654652:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+31:11381:x1875462995381504:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581193.654679:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581193.654705:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70a04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9241 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.654774:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70a04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9241 expref: 32 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.654790:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70a04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9241 expref: 32 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.654809:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:3.0:1788581193.654812:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581193.654816:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce400, rc 0) 00000100:00100000:3.0:1788581193.654902:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+32:11381:x1875462995381504:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 251us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581193.654910:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 148 00000100:00100000:2.0:1788581193.660972:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581193.662149:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995381760 00000100:00100000:1.0:1788581193.662163:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995381760 00000100:00100000:0.0:1788581193.662454:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 39 00000100:00100000:0.0:1788581193.662468:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+32:11381:x1875462995381760:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:0.0:1788581193.662716:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+33:11381:x1875462995381760:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 251us (1754us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1788581193.662725:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 39 00010000:00010000:2.0:1788581193.778309:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581193.810050:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581193.810126:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995382016 00000100:00100000:3.0:1788581193.810139:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995382016 00000100:00100000:3.0:1788581193.810211:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 149 00000100:00100000:3.0:1788581193.810222:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+33:11391:x1875462995382016:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581193.810410:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581193.810443:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70a0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9248 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581193.810548:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788581193.810678:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70a0b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9248 expref: 35 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.810707:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c6f1000) 00010000:00010000:3.0:1788581193.810710:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581193.810715:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70a0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9248 expref: 35 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.810731:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cfa00, rc 0) 00000100:00100000:3.0:1788581193.810800:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+34:11391:x1875462995382016:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 579us (758us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788581193.810807:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 149 00000100:00100000:2.0:1788581193.816584:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581193.816664:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995382144 00000100:00100000:3.0:1788581193.816675:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995382144 00000100:00100000:3.0:1788581193.816732:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 150 00000100:00100000:3.0:1788581193.816743:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+34:11391:x1875462995382144:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:3.0:1788581193.816827:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a19 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.816869:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.816882:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.816899:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.816906:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.816932:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817037:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817046:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817053:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581193.817099:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817116:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817123:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a19 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817131:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817137:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581193.817141:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817149:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a19 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817164:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:3.0:1788581193.817174:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581193.817180:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817187:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817202:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817223:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817229:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817235:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581193.817238:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817543:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817553:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919052341a00) 00010000:00010000:3.0:1788581193.817556:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581193.817559:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817565:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817579:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817592:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817598:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817604:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581193.817607:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817612:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817620:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:3.0:1788581193.817622:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581193.817625:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.817631:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581193.817717:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+34:11391:x1875462995382144:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 973us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581193.817725:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 150 00000100:00100000:2.0:1788581193.827776:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581193.827967:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995382400 00000100:00100000:0.0:1788581193.827979:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995382400 00000100:00100000:0.0:1788581193.828032:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 40 00000100:00100000:0.0:1788581193.828042:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+34:11391:x1875462995382400:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:0.0:1788581193.828298:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+35:11391:x1875462995382400:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 257us (531us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788581193.828306:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 40 00000100:00100000:1.0:1788581193.898302:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581193.898586:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995382656 00000100:00100000:3.0:1788581193.898599:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995382656 00000100:00100000:3.0:1788581193.898664:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 151 00000100:00100000:3.0:1788581193.898676:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+35:11394:x1875462995382656:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581193.898702:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581193.898740:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d924f expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.898833:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.898885:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.898895:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.898908:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.898915:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.898920:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899040:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70a43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899049:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70a43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899056:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70a43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581193.899065:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788581193.899192:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899223:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899230:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899236:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581193.899518:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899529:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899543:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:3.0:1788581193.899546:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581193.899550:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899556:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899569:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899576:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899581:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899586:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581193.899597:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899603:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899611:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919052341a00) 00010000:00010000:3.0:1788581193.899614:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581193.899617:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899623:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899665:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d924f expref: 38 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899679:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70a43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d924f expref: 37 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.899686:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:3.0:1788581193.899688:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581193.899691:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cfa00, rc 0) 00000100:00100000:3.0:1788581193.899766:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+37:11394:x1875462995382656:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1092us (1475us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788581193.899774:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 151 00000100:00100000:2.0:1788581193.904550:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581193.907092:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995382784 00000100:00100000:3.0:1788581193.907110:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995382784 00000100:00100000:3.0:1788581193.907272:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 152 00000100:00100000:3.0:1788581193.907285:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+37:11394:x1875462995382784:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:3.0:1788581193.907374:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.907391:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.907402:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.907428:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.907435:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.907441:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.907448:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581193.907452:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.907461:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.907471:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:3.0:1788581193.907474:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581193.907479:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581193.907485:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581193.907580:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+37:11394:x1875462995382784:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 298us (3040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581193.907588:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 152 00000100:00100000:2.0:1788581193.922508:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581193.922588:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995383040 00000100:00100000:0.0:1788581193.922598:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995383040 00000100:00100000:0.0:1788581193.922658:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:0.0:1788581193.922669:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+37:11394:x1875462995383040:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:0.0:1788581193.922913:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+38:11394:x1875462995383040:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 245us (415us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788581193.922922:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:1.0:1788581194.358044:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581194.358154:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995383296 00000100:00100000:0.0:1788581194.358165:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995383296 00000100:00100000:0.0:1788581194.358285:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 153 00000100:00100000:0.0:1788581194.358297:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+38:11425:x1875462995383296:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:0.0:1788581194.358324:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581194.358347:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70a58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9256 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581194.358451:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70a5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581194.358466:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70a5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581194.358477:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70a5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581194.358487:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788581194.358615:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70a58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9256 expref: 41 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581194.358632:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70a5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9256 expref: 40 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581194.358640:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:0.0:1788581194.358643:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581194.358646:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22800, rc 0) 00000100:00100000:0.0:1788581194.358710:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+40:11425:x1875462995383296:12345-192.168.201.13@tcp:101:cat.0 Request processed in 416us (675us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788581194.358737:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 153 00000100:00080000:3.0:1788581194.359330:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581194.380047:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581194.380137:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581194.380280:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995383552 00000100:00100000:0.0:1788581194.380291:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995383552 00000100:00100000:0.0:1788581194.380357:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:0.0:1788581194.380368:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+40:11425:x1875462995383552:12345-192.168.201.13@tcp:35:cat.0 00000100:00100000:0.0:1788581194.380666:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+41:11425:x1875462995383552:12345-192.168.201.13@tcp:35:cat.0 Request processed in 299us (629us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788581194.380674:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:3.0:1788581194.381004:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995383680 00000100:00100000:3.0:1788581194.381010:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995383680 00000100:00100000:3.0:1788581194.381063:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:3.0:1788581194.381073:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+41:2375:x1875462995383680:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581194.381084:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581194.381110:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70a5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9256 expref: 41 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.381130:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:3.0:1788581194.381134:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581194.381157:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+40:2375:x1875462995383680:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 87us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581194.381164:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:2.0:1788581194.503367:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581194.503503:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995383936 00000100:00100000:1.0:1788581194.503514:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995383936 00000100:00100000:1.0:1788581194.503583:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 154 00000100:00100000:1.0:1788581194.503594:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+40:11431:x1875462995383936:12345-192.168.201.13@tcp:101:dd.0 00010000:00010000:1.0:1788581194.503634:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581194.503637:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788581194.503667:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a709c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d922c expref: 40 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581194.503689:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:1.0:1788581194.503695:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581194.503708:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70a6d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d925d expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581194.503814:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70a74 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581194.503850:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70a43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d924f expref: 40 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581194.503858:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70a74 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581194.503892:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70a43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d924f expref: 40 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581194.503906:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70a43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d924f expref: 40 pid: 9658 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581194.503921:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43215180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5877:1875463014264576:192.168.201.13@tcp:104: 00000100:00100000:1.0:1788581194.504027:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c7480 going to sleep for 11 seconds 00000100:00100000:1.0:1788581194.510989:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43215180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5877:1875463014264576:192.168.201.13@tcp:104: 00010000:00010000:1.0:1788581194.511022:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70a74 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581194.511622:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581194.511691:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995384064 00000100:00100000:3.0:1788581194.511701:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995384064 00010000:00010000:3.0:1788581194.511750:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70a43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d924f expref: 41 pid: 9658 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581194.511792:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 64 00000100:00100000:3.0:1788581194.511803:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+41:2375:x1875462995384064:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581194.511817:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581194.511846:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70a43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d924f expref: 41 pid: 9658 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.511858:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70a43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d924f expref: 41 pid: 9658 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.511879:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70a43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d924f expref: 41 pid: 9658 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.511896:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:3.0:1788581194.511901:0:5863:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70a74 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.511912:0:5863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70a74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.511919:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70a74 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.511995:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581194.512065:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+40:2375:x1875462995384064:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 262us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581194.512072:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 64 00010000:00010000:1.0:1788581194.517436:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70a74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581194.517454:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70a74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581194.517479:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788581194.517660:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70a6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d925d expref: 41 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581194.517696:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70a74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d925d expref: 40 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581194.517706:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:1.0:1788581194.517709:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788581194.517713:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8400, rc 0) 00000100:00100000:1.0:1788581194.517803:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+40:11431:x1875462995383936:12345-192.168.201.13@tcp:101:dd.0 Request processed in 14211us (14447us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788581194.517812:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 154 00000100:00100000:2.0:1788581194.522444:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581194.522702:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995384320 00000100:00100000:0.0:1788581194.522713:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995384320 00000100:00100000:0.0:1788581194.522773:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 155 00000100:00100000:0.0:1788581194.522785:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+40:11431:x1875462995384320:12345-192.168.201.13@tcp:36:dd.0 00010000:00010000:0.0:1788581194.523077:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70a82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581194.523094:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70a82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581194.523106:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70a82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788581194.523166:0:5878:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1788581194.523204:0:5878:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5c27a33 reply state 0000000052c96353 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70a82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581194.523214:0:5878:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788581194.523358:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+43:11431:x1875462995384320:12345-192.168.201.13@tcp:36:dd.0 Request processed in 573us (923us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788581194.523380:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 155 00000020:00080000:0.0:1788581194.523385:0:5878:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788581194.526762:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70a82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.526788:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70a82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.526797:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70a82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.526837:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581194.526843:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70a82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.526851:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70a82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.526869:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:3.0:1788581194.526872:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581194.526877:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70a82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.526883:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70a82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.799387:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581194.882671:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581194.882805:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995384448 00000100:00100000:3.0:1788581194.882815:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995384448 00000100:00100000:3.0:1788581194.882893:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 156 00000100:00100000:3.0:1788581194.882904:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+42:11446:x1875462995384448:12345-192.168.201.13@tcp:101:stat.0 00010000:00010000:3.0:1788581194.882930:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581194.882952:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70a89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9264 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.883030:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.883045:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.883077:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.883093:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.883100:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.883106:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.883195:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.883207:0:5876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70a74 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d925d expref: 43 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.883216:0:5876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a9e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.883304:0:5876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70a74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d925d expref: 43 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.883318:0:5876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70a74 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d925d expref: 43 pid: 5877 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581194.883333:0:5876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5876:1875463014264704:192.168.201.13@tcp:104: 00000100:00100000:3.0:1788581194.883430:0:5876:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c915000 going to sleep for 11 seconds 00000100:00100000:2.0:1788581194.887346:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581194.891610:0:5876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5876:1875463014264704:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581194.891646:0:5876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581194.891781:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995384704 00000100:00100000:0.0:1788581194.891789:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995384704 00000100:00100000:0.0:1788581194.891863:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 43 00000100:00100000:0.0:1788581194.891874:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+44:5610:x1875462995384704:12345-192.168.201.13@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788581194.892223:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+45:5610:x1875462995384704:12345-192.168.201.13@tcp:35:ldlm_bl.0 Request processed in 350us (4885us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788581194.892231:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 43 00000100:00100000:2.0:1788581194.900356:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581194.900507:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995384832 00000100:00100000:3.0:1788581194.900518:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995384832 00010000:00010000:3.0:1788581194.900562:0:5862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70a74 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d925d expref: 45 pid: 5877 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581194.900606:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 65 00000100:00100000:3.0:1788581194.900617:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+45:2374:x1875462995384832:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581194.900631:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581194.900638:0:5862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70a74 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d925d expref: 45 pid: 5877 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.900653:0:5862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70a74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d925d expref: 45 pid: 5877 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.900675:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70a74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d925d expref: 45 pid: 5877 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.900694:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:3.0:1788581194.900699:0:5862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.900708:0:5862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.900717:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a9e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581194.900768:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581194.900845:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+44:2374:x1875462995384832:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 223us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581194.900853:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 65 00010000:00010000:2.0:1788581194.900968:0:5876:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.900977:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581194.901025:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788581194.901031:0:5876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788581194.901056:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901069:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901079:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901086:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901092:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901099:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581194.901103:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901118:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901136:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:2.0:1788581194.901139:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581194.901144:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901151:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70a90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901163:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901169:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901175:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901180:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581194.901183:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901188:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901196:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919052341a00) 00010000:00010000:2.0:1788581194.901198:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581194.901201:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901215:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70a97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901315:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70a89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9264 expref: 44 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901331:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9264 expref: 43 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581194.901339:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:2.0:1788581194.901341:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581194.901344:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce600, rc 0) 00000100:00100000:2.0:1788581194.901380:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+43:11446:x1875462995384448:12345-192.168.201.13@tcp:101:stat.0 Request processed in 18478us (18719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581194.901387:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 156 00000100:00100000:2.0:1788581195.008483:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581195.008602:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995385088 00000100:00100000:0.0:1788581195.008612:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995385088 00000100:00100000:0.0:1788581195.008727:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 157 00000100:00100000:0.0:1788581195.008739:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+43:11452:x1875462995385088:12345-192.168.201.13@tcp:36:truncate.0 00010000:00010000:0.0:1788581195.008803:0:5878:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581195.008848:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70a9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9264 expref: 43 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581195.008870:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:0.0:1788581195.008876:0:5878:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581195.009100:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70aa5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581195.009114:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581195.009124:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788581195.015097:0:5878:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788581195.015149:0:5878:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087da1ba0 reply state 000000003caf4151 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581195.015159:0:5878:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788581195.015311:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+45:11452:x1875462995385088:12345-192.168.201.13@tcp:36:truncate.0 Request processed in 6570us (6835us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788581195.015320:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 157 00000020:00080000:0.0:1788581195.015326:0:5878:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788581195.017052:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.017073:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70aa5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.017080:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70aa5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.017086:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581195.017091:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70aa5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.017118:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70aa5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.017139:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:2.0:1788581195.017142:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581195.017147:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70aa5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.017153:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70aa5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581195.218957:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581195.219212:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995385216 00000100:00100000:1.0:1788581195.219224:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995385216 00000100:00100000:1.0:1788581195.219337:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 158 00000100:00100000:1.0:1788581195.219349:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+44:11466:x1875462995385216:12345-192.168.201.13@tcp:101:stat.0 00010000:00010000:1.0:1788581195.219382:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581195.219404:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70aac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d926b expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219471:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70ab3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219485:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70ab3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219496:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70ab3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219513:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70aba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219533:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219540:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219627:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70ac1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219636:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219642:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581195.219678:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788581195.219683:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788581195.219705:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219717:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219724:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70ab3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219730:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70ab3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219735:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70ab3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219750:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581195.219755:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70ab3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219763:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70ab3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219776:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:1.0:1788581195.219779:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581195.219783:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70ab3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219789:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70ab3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219802:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219808:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70aba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219842:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70aba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219848:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9a00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581195.219852:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70aba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219858:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70aba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219876:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91905c6f1c00) 00010000:00010000:1.0:1788581195.219879:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581195.219882:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70aba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219888:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70aba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219924:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70aac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d926b expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219938:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d926b expref: 45 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.219945:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:1.0:1788581195.219948:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581195.219950:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8600, rc 0) 00000100:00100000:1.0:1788581195.220025:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+45:11466:x1875462995385216:12345-192.168.201.13@tcp:101:stat.0 Request processed in 678us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581195.220033:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 158 00000100:00100000:3.0:1788581195.342869:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581195.343021:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995385472 00000100:00100000:1.0:1788581195.343033:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995385472 00000100:00100000:1.0:1788581195.343095:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 159 00000100:00100000:1.0:1788581195.343105:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+45:11476:x1875462995385472:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1788581195.343125:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581195.343146:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70ac8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9272 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581195.343315:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788581195.343426:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70ac8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9272 expref: 47 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.343441:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c6f1000) 00010000:00010000:1.0:1788581195.343444:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581195.343449:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70ac8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9272 expref: 47 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.343463:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8000, rc 0) 00000100:00100000:1.0:1788581195.343513:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+46:11476:x1875462995385472:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 409us (654us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788581195.343520:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 159 00000100:00100000:3.0:1788581195.348686:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581195.348767:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995385728 00000100:00100000:1.0:1788581195.348778:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995385728 00000100:00100000:1.0:1788581195.348853:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:1.0:1788581195.348864:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190673cd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+46:11476:x1875462995385728:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:1.0:1788581195.349104:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190673cd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+47:11476:x1875462995385728:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 241us (428us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788581195.349112:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:2.0:1788581195.377165:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581195.377191:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014265088:0@lo:400:kworker.0 00000100:00100000:2.0:1788581195.377291:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581195.377371:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014265216:0@lo:400:kworker.0 00000100:00100000:2.0:1788581195.377396:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581195.377426:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014265216 00000100:00100000:2.0:1788581195.377434:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014265216 00000100:00100000:2.0:1788581195.377492:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788581195.377502:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014265216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581195.377554:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014265216:12345-0@lo:400:kworker.0 Request processed in 54us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581195.377561:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1788581195.377579:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581195.377602:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014265216:0@lo:400:kworker.0 00000100:00100000:1.0:1788581195.377827:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014264832:0@lo:400:kworker.0 00000100:00100000:1.0:1788581195.377871:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581195.377901:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014265344:0@lo:400:kworker.0 00000100:00100000:1.0:1788581195.377922:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581195.377959:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788581195.377965:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014264960:0@lo:400:kworker.0 00000100:00100000:1.0:1788581195.377985:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581195.377999:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014265472:0@lo:400:kworker.0 00000100:00100000:1.0:1788581195.378017:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581195.378040:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014265472 00000100:00100000:1.0:1788581195.378044:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014265472 00000100:00100000:1.0:1788581195.378072:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788581195.378078:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3340:x1875463014265472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581195.378111:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3340:x1875463014265472:12345-0@lo:400:kworker.0 Request processed in 33us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581195.378116:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788581195.378141:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014265472:0@lo:400:kworker.0 00000100:00100000:1.0:1788581195.378159:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014265088 00000100:00100000:1.0:1788581195.378162:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014265088 00000100:00100000:1.0:1788581195.378184:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014265344 00000100:00100000:1.0:1788581195.378186:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014265344 00000100:00100000:1.0:1788581195.378197:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014264960 00000100:00100000:1.0:1788581195.378199:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014264960 00000100:00100000:1.0:1788581195.378211:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788581195.378216:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014265088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581195.378285:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014265088:12345-0@lo:400:kworker.0 Request processed in 69us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581195.378292:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788581195.378304:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788581195.378310:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014265344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581195.378335:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014265344:12345-0@lo:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581195.378346:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788581195.378357:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788581195.378362:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014264960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581195.378386:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014264960:12345-0@lo:400:kworker.0 Request processed in 24us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581195.378391:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788581195.378412:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014264960:0@lo:400:kworker.0 00000100:00100000:1.0:1788581195.378420:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014265344:0@lo:400:kworker.0 00000100:00100000:2.0:1788581195.379207:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014264832 00000100:00100000:2.0:1788581195.379235:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014264832 00000100:00100000:2.0:1788581195.379307:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788581195.379314:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014264832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581195.379376:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014264832:12345-0@lo:400:kworker.0 Request processed in 62us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581195.379383:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:2.0:1788581195.379412:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581195.379419:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581195.379445:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014265088:0@lo:400:kworker.0 00000100:00100000:1.0:1788581195.380176:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014264832:0@lo:400:kworker.0 00000100:00100000:2.0:1788581195.442492:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581195.442591:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995385984 00000100:00100000:1.0:1788581195.442601:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995385984 00000100:00100000:1.0:1788581195.442664:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 160 00000100:00100000:1.0:1788581195.442676:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+47:11482:x1875462995385984:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:1.0:1788581195.442702:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581195.442737:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70ad6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9279 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.442860:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70add lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.442875:0:9658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70ac1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d926b expref: 48 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.442885:0:9658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70add lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.442943:0:9658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d926b expref: 48 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.442956:0:9658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d926b expref: 48 pid: 5877 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581195.442971:0:9658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076886680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9658:1875463014265600:192.168.201.13@tcp:104: 00000100:00100000:1.0:1788581195.443070:0:9658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581195.451048:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581195.451211:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995386112 00000100:00100000:0.0:1788581195.451221:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995386112 00010000:00010000:0.0:1788581195.451298:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70ac1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d926b expref: 49 pid: 5877 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581195.451341:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 66 00000100:00100000:0.0:1788581195.451352:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+49:2374:x1875462995386112:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581195.451366:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581195.451373:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70ac1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d926b expref: 49 pid: 5877 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581195.451387:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d926b expref: 49 pid: 5877 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581195.451410:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:0.0:1788581195.451415:0:5863:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70add lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581195.451442:0:5863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70add lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581195.451450:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70add lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581195.451469:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581195.451536:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+49:2374:x1875462995386112:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 186us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581195.451544:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 66 00010000:00010000:1.0:1788581195.452701:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70ac1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d926b expref: 48 pid: 5877 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581195.452735:0:9658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076886680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9658:1875463014265600:192.168.201.13@tcp:104: 00010000:00010000:1.0:1788581195.452758:0:9658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70add lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.452767:0:9658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70add lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.452774:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70add lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581195.452794:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788581195.452958:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70ad6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9279 expref: 49 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.452973:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70add lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9279 expref: 48 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.452997:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:1.0:1788581195.453001:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788581195.453003:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9a00, rc 0) 00000100:00100000:1.0:1788581195.453060:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+48:11482:x1875462995385984:12345-192.168.201.13@tcp:101:bash.0 Request processed in 10386us (10578us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788581195.453068:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 160 00000100:00100000:3.0:1788581195.459986:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581195.460099:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995386368 00000100:00100000:1.0:1788581195.460109:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995386368 00000100:00100000:1.0:1788581195.460183:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 161 00000100:00100000:1.0:1788581195.460194:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+48:11482:x1875462995386368:12345-192.168.201.13@tcp:36:bash.0 00010000:00010000:1.0:1788581195.460500:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70aeb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.460518:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70aeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.460529:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70aeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788581195.460579:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1788581195.460604:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f77f2a0 reply state 0000000016322487 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70aeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581195.460614:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788581195.460699:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+51:11482:x1875462995386368:12345-192.168.201.13@tcp:36:bash.0 Request processed in 505us (722us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788581195.460706:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 161 00000020:00080000:1.0:1788581195.460720:0:5877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788581195.463712:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70aeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.463743:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70aeb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.463751:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70aeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.463757:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581195.463762:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70aeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.463770:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70aeb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.463787:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:2.0:1788581195.463790:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581195.463795:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70aeb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.463836:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70aeb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581195.469652:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581195.469961:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995386496 00000100:00100000:0.0:1788581195.469973:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995386496 00000100:00100000:0.0:1788581195.470039:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 162 00000100:00100000:0.0:1788581195.470049:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+50:11482:x1875462995386496:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:0.0:1788581195.470074:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581195.470098:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70af2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9280 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581195.470195:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70af9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581195.470212:0:5878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70add lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9279 expref: 51 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581195.470228:0:5878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70af9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581195.470288:0:5878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70add lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9279 expref: 51 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581195.470315:0:5878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70add lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9279 expref: 51 pid: 9658 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581195.470331:0:5878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919047c5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5878:1875463014265728:192.168.201.13@tcp:104: 00000100:00100000:0.0:1788581195.470416:0:5878:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f4357fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581195.473803:0:5878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919047c5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5878:1875463014265728:192.168.201.13@tcp:104: 00010000:00010000:0.0:1788581195.473913:0:5878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70af9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581195.475354:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581195.475704:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995386624 00000100:00100000:1.0:1788581195.475715:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995386624 00010000:00010000:1.0:1788581195.475827:0:5862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70add lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9279 expref: 52 pid: 9658 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581195.475873:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 67 00000100:00100000:1.0:1788581195.475883:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:2374:x1875462995386624:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581195.475898:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581195.475904:0:5862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70add lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9279 expref: 52 pid: 9658 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.475917:0:5862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70add lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9279 expref: 52 pid: 9658 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.475938:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70add lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9279 expref: 52 pid: 9658 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.475954:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:1.0:1788581195.475959:0:5862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70af9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.475969:0:5862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.475977:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70af9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.476060:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581195.476114:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+51:2374:x1875462995386624:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 231us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581195.476133:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 67 00010000:00010000:2.0:1788581195.478102:0:5878:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.478119:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581195.478170:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788581195.478175:0:5878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788581195.478199:0:5878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.478368:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70af2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9280 expref: 51 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.478389:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70af9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9280 expref: 50 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.478398:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:2.0:1788581195.478401:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581195.478405:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22600, rc 0) 00000100:00100000:2.0:1788581195.478616:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+50:11482:x1875462995386496:12345-192.168.201.13@tcp:101:bash.0 Request processed in 8567us (8985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581195.478627:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 162 00000100:00100000:3.0:1788581195.482460:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581195.482653:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995386880 00000100:00100000:1.0:1788581195.482663:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995386880 00000100:00100000:1.0:1788581195.482712:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:1.0:1788581195.482734:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+50:11482:x1875462995386880:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:1.0:1788581195.483013:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+51:11482:x1875462995386880:12345-192.168.201.13@tcp:35:bash.0 Request processed in 292us (562us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788581195.483022:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:3.0:1788581195.592888:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581195.593040:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995387136 00000100:00100000:1.0:1788581195.593050:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995387136 00000100:00100000:1.0:1788581195.593110:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 163 00000100:00100000:1.0:1788581195.593119:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+51:11492:x1875462995387136:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1788581195.593143:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581195.593162:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70b00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9287 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581195.593293:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788581195.593401:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70b00 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9287 expref: 53 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.593416:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c6f1000) 00010000:00010000:1.0:1788581195.593419:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581195.593424:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70b00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9287 expref: 53 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.593438:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9a00, rc 0) 00000100:00100000:1.0:1788581195.593511:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:11492:x1875462995387136:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 392us (633us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1788581195.593518:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 163 00000100:00100000:3.0:1788581195.597389:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581195.597575:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995387264 00000100:00100000:1.0:1788581195.597586:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995387264 00000100:00100000:1.0:1788581195.597645:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 164 00000100:00100000:1.0:1788581195.597655:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:11492:x1875462995387264:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:1.0:1788581195.597742:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.597759:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.597770:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.597785:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.597792:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.597799:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.597904:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70b1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.597912:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.597919:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788581195.597973:0:9658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.597985:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.597992:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.597999:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598004:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581195.598009:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598016:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598027:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:1.0:1788581195.598030:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581195.598034:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598040:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598053:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598058:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598069:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598074:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581195.598077:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598083:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598090:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91905c6f1c00) 00010000:00010000:1.0:1788581195.598092:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581195.598095:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598100:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598118:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598125:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70b1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598131:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70b1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598135:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581195.598138:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70b1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598152:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70b1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598159:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:1.0:1788581195.598161:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581195.598164:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70b1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.598170:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70b1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581195.598285:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:11492:x1875462995387264:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 631us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581195.598294:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 164 00000100:00100000:2.0:1788581195.603113:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581195.603188:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995387520 00000100:00100000:1.0:1788581195.603198:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995387520 00000100:00100000:1.0:1788581195.603294:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:1.0:1788581195.603304:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:11492:x1875462995387520:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:1.0:1788581195.603669:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+53:11492:x1875462995387520:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 364us (564us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788581195.603677:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:0.0:1788581195.655541:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581195.655584:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581195.655613:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581195.655653:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581195.655692:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995388032 00000100:00100000:0.0:1788581195.655703:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995388032 00000100:00100000:0.0:1788581195.655779:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 164 00000100:00100000:0.0:1788581195.655790:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2372:x1875462995388032:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581195.656034:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995387904 00000100:00100000:3.0:1788581195.656040:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995387904 00000100:00100000:3.0:1788581195.656073:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995387776 00000100:00100000:3.0:1788581195.656076:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995387776 00000100:00100000:3.0:1788581195.656097:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 94 00000100:00100000:3.0:1788581195.656104:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2372:x1875462995387904:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581195.656162:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2372:x1875462995387904:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 58us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581195.656170:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 94 00000100:00100000:3.0:1788581195.656186:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 95 00000100:00100000:3.0:1788581195.656192:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2372:x1875462995387776:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581195.656215:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2372:x1875462995387776:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 24us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581195.656237:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 95 00000100:00100000:0.0:1788581195.656451:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2372:x1875462995388032:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 662us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581195.656460:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 164 00000100:00080000:2.0:1788581195.656577:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788581195.656582:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581195.656591:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581195.656876:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995387648 00000100:00100000:1.0:1788581195.656881:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995387648 00000100:00100000:1.0:1788581195.656924:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 301 00000100:00100000:1.0:1788581195.656932:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2372:x1875462995387648:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581195.656981:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2372:x1875462995387648:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 50us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581195.656998:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 301 00000100:00100000:0.0:1788581195.668357:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581195.668567:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995388288 00000100:00100000:1.0:1788581195.668578:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995388288 00000100:00100000:1.0:1788581195.668641:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 165 00000100:00100000:1.0:1788581195.668653:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+53:11495:x1875462995388288:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:1.0:1788581195.668678:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581195.668699:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70b23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d928e expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.668788:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.668802:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.668823:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669011:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669020:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669027:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669145:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70b38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669172:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669179:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581195.669192:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788581195.669327:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669335:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669342:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669347:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581195.669352:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669359:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669371:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:1.0:1788581195.669375:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581195.669379:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669385:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70b2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669399:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669411:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669417:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669422:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581195.669425:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669550:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669559:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91905c6f1c00) 00010000:00010000:1.0:1788581195.669562:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581195.669565:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669571:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8600/0xf54e3944c2a70b31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669617:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a70b23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d928e expref: 56 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669630:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70b38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d928e expref: 55 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581195.669638:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:1.0:1788581195.669640:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581195.669649:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9a00, rc 0) 00000100:00100000:1.0:1788581195.669824:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:11495:x1875462995388288:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1171us (1476us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788581195.669902:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 165 00000100:00100000:2.0:1788581195.677918:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581195.678003:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581195.678126:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995388416 00000100:00100000:0.0:1788581195.678136:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995388416 00000100:00100000:0.0:1788581195.678195:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:0.0:1788581195.678205:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f715f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:2375:x1875462995388416:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581195.678271:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581195.678295:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70b38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d928e expref: 55 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581195.678316:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:0.0:1788581195.678320:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581195.678373:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f715f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:2375:x1875462995388416:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 169us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581195.678380:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:3.0:1788581195.678986:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995388544 00000100:00100000:3.0:1788581195.678994:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995388544 00000100:00100000:3.0:1788581195.679035:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 166 00000100:00100000:3.0:1788581195.679042:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:11495:x1875462995388544:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:3.0:1788581195.679099:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.679114:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.679126:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.679156:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.679163:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.679170:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.679176:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581195.679180:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.679188:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.679197:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:3.0:1788581195.679208:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581195.679212:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.679228:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581195.679304:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:11495:x1875462995388544:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 262us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581195.679311:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 166 00000100:00100000:2.0:1788581195.683795:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581195.683955:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995388800 00000100:00100000:1.0:1788581195.683965:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995388800 00000100:00100000:1.0:1788581195.684021:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 47 00000100:00100000:1.0:1788581195.684030:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:11495:x1875462995388800:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:1.0:1788581195.684305:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:11495:x1875462995388800:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 274us (517us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788581195.684313:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 47 00010000:00010000:0.0:1788581195.832897:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788581195.887588:0:8144:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 412128340979ns, next at 413128338109ns, rc = 0 00000100:00100000:0.0:1788581195.887672:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014265856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581195.887741:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581195.887952:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014265856 00000100:00100000:1.0:1788581195.887960:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014265856 00000100:00100000:1.0:1788581195.888010:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788581195.888020:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014265856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581195.888054:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581195.888113:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014265856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581195.888120:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788581195.888280:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014265856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581195.906286:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581195.906423:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995389056 00000100:00100000:2.0:1788581195.906439:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995389056 00000100:00100000:2.0:1788581195.906500:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 167 00000100:00100000:2.0:1788581195.906512:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:11513:x1875462995389056:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:2.0:1788581195.906535:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581195.906556:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70b4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9295 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.906658:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70b54 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.906673:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70b54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.906685:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70b54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581195.906696:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788581195.906848:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70b4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9295 expref: 58 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.906869:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70b54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9295 expref: 57 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581195.906879:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:2.0:1788581195.906882:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788581195.906897:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb83800, rc 0) 00000100:00100000:2.0:1788581195.906989:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:11513:x1875462995389056:12345-192.168.201.13@tcp:101:cat.0 Request processed in 478us (751us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788581195.906997:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 167 00000100:00100000:2.0:1788581195.965557:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581195.965643:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995389184 00000100:00100000:3.0:1788581195.965654:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995389184 00000100:00100000:3.0:1788581195.965712:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 168 00000100:00100000:3.0:1788581195.965721:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:11514:x1875462995389184:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581195.965744:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581195.965764:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d929c expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.965849:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70b69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.965863:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.965874:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581195.965907:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788581195.965911:0:5876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581195.965927:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.965970:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d929c expref: 59 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.965988:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70b69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d929c expref: 58 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.965997:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:3.0:1788581195.966000:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581195.966003:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cee00, rc 0) 00000100:00100000:3.0:1788581195.966069:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:11514:x1875462995389184:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 348us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581195.966086:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 168 00000100:00100000:3.0:1788581195.978318:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581195.978539:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995389568 00000100:00100000:1.0:1788581195.978550:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995389568 00000100:00100000:1.0:1788581195.978612:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:1.0:1788581195.978621:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:11514:x1875462995389568:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:1.0:1788581195.978970:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:11514:x1875462995389568:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 348us (661us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788581195.978993:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:1.0:1788581195.982051:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581195.982233:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995389696 00000100:00100000:3.0:1788581195.982269:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995389696 00000100:00100000:3.0:1788581195.982338:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:3.0:1788581195.982350:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076886a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:11514:x1875462995389696:12345-192.168.201.13@tcp:103:lfs.0 00010000:00010000:3.0:1788581195.982363:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788581195.982389:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70af9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9280 expref: 59 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.982411:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70b54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9295 expref: 58 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.982423:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70a04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9241 expref: 57 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581195.982455:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341d00) 00010000:00010000:3.0:1788581195.982465:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581195.982530:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076886a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+56:11514:x1875462995389696:12345-192.168.201.13@tcp:103:lfs.0 Request processed in 183us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581195.982538:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:2.0:1788581195.985552:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581195.985645:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995389824 00000100:00100000:0.0:1788581195.985655:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995389824 00000100:00100000:0.0:1788581195.985719:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 169 00000100:00100000:0.0:1788581195.985730:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+56:11514:x1875462995389824:12345-192.168.201.13@tcp:58:lfs.0 00010000:00010000:0.0:1788581195.985878:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70b70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581195.985894:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70b70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581195.985907:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70b70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788581195.986110:0:5878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788581195.988414:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+56:11514:x1875462995389824:12345-192.168.201.13@tcp:58:lfs.0 Request processed in 486us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581195.988434:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 169 00000100:00100000:2.0:1788581196.022835:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581196.022963:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995389952 00000100:00100000:3.0:1788581196.022973:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995389952 00000100:00100000:3.0:1788581196.023044:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 170 00000100:00100000:3.0:1788581196.023054:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+56:11516:x1875462995389952:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581196.023075:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581196.023097:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70b77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d92a3 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023160:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023174:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023185:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023200:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70b85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023207:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023389:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023506:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70b8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023515:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70b8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023522:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70b8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581196.023559:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788581196.023563:0:5876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581196.023582:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70b8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023594:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70b8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023603:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023610:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023617:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023623:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581196.023628:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023647:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023662:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:3.0:1788581196.023664:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581196.023669:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023676:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70b7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023692:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023698:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70b85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023705:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70b85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023709:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cec00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581196.023712:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70b85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023718:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70b85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023724:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919052341d00) 00010000:00010000:3.0:1788581196.023727:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581196.023729:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70b85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023744:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70b85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023775:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70b77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92a3 expref: 58 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023786:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70b8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92a3 expref: 57 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.023793:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91904995ad00) 00010000:00010000:3.0:1788581196.023796:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581196.023810:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf800, rc 0) 00000100:00100000:3.0:1788581196.024012:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:11516:x1875462995389952:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 959us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581196.024019:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 170 00000100:00080000:2.0:1788581196.024472:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1788581196.506712:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1788581196.506736:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000040:00080000:1.0:1788581196.783521:0:11735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788581196.783531:0:11735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788581196.783589:0:11735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788581196.783597:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788581196.783726:0:11735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076884380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11735:1875463014265984:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788581196.783840:0:11735:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788581196.790695:0:11735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076884380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11735:1875463014265984:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788581196.794344:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581196.794452:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995390080 00000100:00100000:0.0:1788581196.794463:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995390080 00000100:00100000:0.0:1788581196.794524:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 171 00000100:00100000:0.0:1788581196.794535:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:11527:x1875462995390080:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788581196.794567:0:5878:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788581196.794697:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:11527:x1875462995390080:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 163us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581196.794705:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 171 00000100:00100000:3.0:1788581196.804104:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581196.804294:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995390208 00000100:00100000:0.0:1788581196.804304:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995390208 00000100:00100000:0.0:1788581196.804357:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 172 00000100:00100000:0.0:1788581196.804368:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:11527:x1875462995390208:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788581196.804447:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70b93 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804463:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70b93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804476:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70b93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804492:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70b9a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804517:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70b9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804524:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70b9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804551:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70ba1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804559:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804565:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581196.804601:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788581196.804605:0:5876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788581196.804618:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804629:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70b93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804634:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70b93 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804657:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70b93 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804663:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581196.804667:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70b93 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804681:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70b93 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804695:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91904995af00) 00010000:00010000:0.0:1788581196.804698:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581196.804702:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70b93 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804709:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70b93 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804723:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70b9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804729:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70b9a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804734:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70b9a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804739:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581196.804741:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70b9a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804747:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70b9a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804754:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff91904995a400) 00010000:00010000:0.0:1788581196.804757:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581196.804759:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70b9a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804775:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70b9a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804799:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804814:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70ba1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804821:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804826:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23e00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581196.804829:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804834:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70ba1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804841:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91904995ad00) 00010000:00010000:0.0:1788581196.804843:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581196.804846:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70ba1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.804851:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70ba1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581196.804926:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:11527:x1875462995390208:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 Request processed in 558us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581196.804934:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 172 00000100:00100000:2.0:1788581196.834125:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581196.834282:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995390464 00000100:00100000:1.0:1788581196.834293:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995390464 00000100:00100000:1.0:1788581196.834347:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 173 00000100:00100000:1.0:1788581196.834358:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:11527:x1875462995390464:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581196.834377:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581196.834397:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70ba8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d92aa expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.834511:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70baf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.834526:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70baf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.834537:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70baf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581196.834564:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788581196.834662:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70baf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.834671:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70baf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.834678:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70baf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.834683:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581196.834688:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70baf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.834695:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70baf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.834707:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91904995ad00) 00010000:00010000:1.0:1788581196.834710:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581196.834715:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70baf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.834720:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70baf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.834759:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70ba8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92aa expref: 59 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.834769:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91904995af00) 00010000:00010000:1.0:1788581196.834772:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581196.834784:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70ba8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92aa expref: 59 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.834828:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9c00, rc 0) 00000100:00100000:1.0:1788581196.834890:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:11527:x1875462995390464:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 534us (774us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1788581196.834899:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 173 00000100:00100000:1.0:1788581196.843986:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581196.844022:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995390592 00000100:00100000:1.0:1788581196.844031:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995390592 00000100:00100000:1.0:1788581196.844071:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 174 00000100:00100000:1.0:1788581196.844079:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:11527:x1875462995390592:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788581196.844116:0:5876:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788581196.844233:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:11527:x1875462995390592:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 153us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581196.844258:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 174 00010000:00010000:2.0:1788581196.857364:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581196.858971:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581196.859026:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995390848 00000100:00100000:1.0:1788581196.859037:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995390848 00000100:00100000:1.0:1788581196.859090:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 175 00000100:00100000:1.0:1788581196.859100:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:11527:x1875462995390848:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581196.859123:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581196.859126:0:5878:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788581196.859152:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70b69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d929c expref: 58 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.859169:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:1.0:1788581196.859184:0:5878:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581196.859199:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70bbd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d92b1 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788581196.863157:0:5878:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788581196.863611:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70bc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.863628:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.863639:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.863703:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9a00/0xf54e3944c2a70bbd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92b1 expref: 60 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.863722:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92b1 expref: 59 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.863731:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91904995a400) 00010000:00010000:0.0:1788581196.863734:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581196.863737:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22200, rc 0) 00000100:00100000:0.0:1788581196.863822:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:11527:x1875462995390848:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 4723us (4860us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788581196.863831:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 175 00000100:00100000:0.0:1788581196.881808:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581196.881856:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995391104 00000100:00100000:0.0:1788581196.881866:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995391104 00000100:00100000:0.0:1788581196.881924:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 176 00000100:00100000:0.0:1788581196.881933:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:11527:x1875462995391104:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788581196.881993:0:5876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581196.882021:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70bc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92b1 expref: 59 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882049:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91904995a400) 00010000:00010000:0.0:1788581196.882060:0:5876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581196.882084:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70bd2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882097:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882106:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882155:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x3e542bdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882163:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3e542bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882171:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3e542bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882236:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882271:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70bd2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882277:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70bd2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882284:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581196.882288:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70bd2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882304:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70bd2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882313:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:0.0:1788581196.882316:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581196.882320:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70bd2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882326:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70bd2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882335:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3e542bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882341:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3e542bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882347:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3e542bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882353:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23e00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581196.882356:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3e542bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882361:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bd9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3e542bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882367:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x3e542bdb (ffff91904995a000) 00010000:00010000:0.0:1788581196.882369:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581196.882372:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bd9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3e542bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.882385:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3e542bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581196.882481:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:11527:x1875462995391104:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 548us (692us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788581196.882488:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 176 00000100:00100000:0.0:1788581196.888369:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581196.888497:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995391232 00000100:00100000:3.0:1788581196.888509:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995391232 00000100:00100000:3.0:1788581196.888563:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 177 00000100:00100000:3.0:1788581196.888573:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:11527:x1875462995391232:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581196.888591:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581196.888612:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70be0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d92b8 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.888645:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70be7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.888675:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70be7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.888686:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70be7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.888771:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70be0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92b8 expref: 60 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.888799:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70be7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92b8 expref: 59 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.888815:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919052341d00) 00010000:00010000:3.0:1788581196.888818:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788581196.888821:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf200, rc 0) 00000100:00100000:3.0:1788581196.888872:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:11527:x1875462995391232:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 300us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581196.888879:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 177 00000100:00100000:3.0:1788581196.902394:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581196.902744:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995391488 00000100:00100000:0.0:1788581196.902756:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995391488 00000100:00100000:0.0:1788581196.902831:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 178 00000100:00100000:0.0:1788581196.902841:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:11527:x1875462995391488:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788581196.902932:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.902951:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.902962:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788581196.903319:0:5876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1788581196.903331:0:5876:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413144087399ns, next at 414144084322ns, rc = 0 00000004:00010000:0.0:1788581196.903423:0:5876:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e09023a reply state 0000000061b8189e transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581196.903432:0:5876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788581196.903538:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+61:11527:x1875462995391488:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 697us (1154us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788581196.903562:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 178 00010000:00010000:1.0:1788581196.907087:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.907103:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.907110:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.907116:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23e00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581196.907121:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.907129:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.907146:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919052341d00) 00010000:00010000:1.0:1788581196.907149:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788581196.907149:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00010000:00010000:1.0:1788581196.907153:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.907160:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70bee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581196.907222:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995391616 00000100:00100000:3.0:1788581196.907232:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995391616 00000100:00100000:3.0:1788581196.907315:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 179 00000100:00100000:3.0:1788581196.907326:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+60:11527:x1875462995391616:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581196.907351:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581196.907369:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70bf5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d92bf expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.907452:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92bf expref: 61 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.907466:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92bf expref: 61 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.907482:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919052341d00) 00010000:00010000:3.0:1788581196.907485:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581196.907488:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce400, rc 0) 00000100:00100000:3.0:1788581196.907541:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+61:11527:x1875462995391616:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 217us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581196.907549:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 179 00000100:00100000:1.0:1788581196.911620:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581196.911691:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995391744 00000100:00100000:3.0:1788581196.911701:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995391744 00000100:00100000:3.0:1788581196.911755:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:3.0:1788581196.911765:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995391744:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788581196.912112:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2374:x1875462995391744:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 346us (500us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788581196.912119:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:1.0:1788581196.919333:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581196.919455:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995392000 00000100:00100000:2.0:1788581196.919465:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995392000 00000100:00100000:2.0:1788581196.919518:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:2.0:1788581196.919526:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+61:11527:x1875462995392000:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788581196.919758:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+62:11527:x1875462995392000:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 232us (433us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788581196.919767:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:2.0:1788581196.923045:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581196.923155:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995392256 00000100:00100000:3.0:1788581196.923165:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995392256 00000100:00100000:3.0:1788581196.923226:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 180 00000100:00100000:3.0:1788581196.923235:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+62:11527:x1875462995392256:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788581196.923369:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+62:11527:x1875462995392256:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 134us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581196.923392:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 180 00000100:00100000:1.0:1788581196.927190:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581196.928940:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995392384 00000100:00100000:0.0:1788581196.928953:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995392384 00000100:00100000:0.0:1788581196.929089:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 181 00000100:00100000:0.0:1788581196.929100:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+62:11527:x1875462995392384:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581196.929120:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581196.929139:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70bfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d92c6 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.929215:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70c03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.929229:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.929268:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581196.929303:0:5878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788581196.929319:0:5878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.929344:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70bfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92c6 expref: 64 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.929359:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70c03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92c6 expref: 63 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.929380:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919052341d00) 00010000:00010000:0.0:1788581196.929383:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788581196.929386:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22200, rc 0) 00000100:00100000:0.0:1788581196.929447:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+63:11527:x1875462995392384:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 350us (2266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581196.929455:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 181 00000100:00100000:2.0:1788581196.939711:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581196.941926:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995392512 00000100:00100000:1.0:1788581196.941949:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995392512 00000100:00100000:1.0:1788581196.942017:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 51 00000100:00100000:1.0:1788581196.942028:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2374:x1875462995392512:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581196.942048:0:6722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581196.942072:0:6722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70c0a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d92cd expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788581196.942101:0:6722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b954c, blocks: 0x1 00010000:00010000:1.0:1788581196.942119:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1788581196.942125:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581196.942134:0:6722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70c0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92cd expref: 8 pid: 6722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.942152:0:6722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70c0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92cd expref: 8 pid: 6722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581196.942166:0:6722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8400, rc 0) 00000100:00100000:1.0:1788581196.943273:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2374:x1875462995392512:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 1205us (3531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581196.943284:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 51 00000100:00100000:2.0:1788581196.947106:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581196.947179:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995392768 00000100:00100000:3.0:1788581196.947189:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995392768 00000100:00100000:3.0:1788581196.947282:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 182 00000100:00100000:3.0:1788581196.947293:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+63:11527:x1875462995392768:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788581196.947399:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+63:11527:x1875462995392768:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 108us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581196.947407:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 182 00000100:00100000:0.0:1788581196.950088:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581196.950151:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995392896 00000100:00100000:3.0:1788581196.950160:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995392896 00000100:00100000:3.0:1788581196.950218:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 52 00000100:00100000:3.0:1788581196.950227:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:11527:x1875462995392896:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581196.950387:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581196.950408:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70c11 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d92d4 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.950440:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70c0a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92cd expref: 9 pid: 6722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.950450:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581196.950454:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581196.950460:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70c11 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92d4 expref: 9 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.950490:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70c0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92cd expref: 9 pid: 6722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.950518:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70c0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92cd expref: 9 pid: 6722 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581196.950533:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6725:1875463014266112:192.168.201.13@tcp:104: 00000100:00100000:3.0:1788581196.950647:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190525770c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581196.963300:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6725:1875463014266112:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581196.963341:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70c11 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92d4 expref: 9 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581196.963362:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cec00, rc 0) 00000100:00100000:3.0:1788581196.963417:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:11527:x1875462995392896:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 13190us (13335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581196.963426:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 52 00000100:00100000:1.0:1788581196.971324:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581196.971904:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995393024 00000100:00100000:0.0:1788581196.971915:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995393024 00010000:00010000:0.0:1788581196.971957:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70c0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92cd expref: 9 pid: 6722 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581196.972005:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 68 00000100:00100000:0.0:1788581196.972014:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:2374:x1875462995393024:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581196.972027:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581196.972050:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70c0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92cd expref: 9 pid: 6722 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.972065:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70c0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92cd expref: 9 pid: 6722 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.972087:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70c0a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92cd expref: 9 pid: 6722 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.972115:0:5863:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581196.972119:0:5863:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581196.972129:0:5863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70c11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92d4 expref: 8 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.972138:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70c11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92d4 expref: 8 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581196.972174:0:5863:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70c11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92d4 expref: 8 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581196.972190:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919047c5b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5863:1875463014266240:192.168.201.13@tcp:105: 00000100:00100000:0.0:1788581196.972305:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f4357fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581196.986314:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581196.986353:0:6730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995393152 00000100:00100000:1.0:1788581196.986362:0:6730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995393152 00002000:00100000:1.0:1788581196.986409:0:6730:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9190779cc380 x1875462995393152/t0(0) o4->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:552/0 lens 504/0 e 0 to 0 dl 1788581207 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788581196.986434:0:6730:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9190779cc380 with x1875462995393152 ext(0->8) 00002000:00010000:1.0:1788581196.986440:0:6730:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9190779cc380 00000100:00100000:1.0:1788581196.986466:0:6730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:1.0:1788581196.986475:0:6730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:2373:x1875462995393152:12345-192.168.201.13@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788581196.986896:0:6730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+11:2373:x1875462995393152:12345-192.168.201.13@tcp:4:lhsmtool_posix.0 Request processed in 420us (591us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788581196.986904:0:6730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 4 00002000:00100000:1.0:1788581196.986911:0:6730:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9190779cc380 x1875462995393152/t4294967314(0) o4->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:552/0 lens 504/448 e 0 to 0 dl 1788581207 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788581196.986919:0:6730:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9190779cc380 with x1875462995393152 ext(0->8) 00002000:00010000:1.0:1788581196.986923:0:6730:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9190779cc380 00000100:00100000:2.0:1788581196.988354:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919047c5b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5863:1875463014266240:192.168.201.13@tcp:105: 00010000:00010000:2.0:1788581196.988381:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581196.988434:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+10:2374:x1875462995393024:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 16421us (17119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581196.988443:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 68 00000100:00100000:0.0:1788581196.994222:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581196.994482:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995393280 00000100:00100000:3.0:1788581196.994492:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995393280 00000100:00100000:3.0:1788581196.994542:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 183 00000100:00100000:3.0:1788581196.994552:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+63:11527:x1875462995393280:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 00000040:00080000:3.0:1788581197.047988:0:12457:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788581197.047998:0:12457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788581197.048039:0:12457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788581197.048045:0:12457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788581197.141867:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+63:11527:x1875462995393280:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 Request processed in 147304us (147642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581197.141892:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 183 00000001:00080000:3.0:1788581197.141933:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1788581197.141940:0:5899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:3.0:1788581197.141975:0:5899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788581197.141991:0:5899:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff918f4357f240 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788581197.141995:0:5899:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91907b819700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff918f4357f000 00000020:00080000:3.0:1788581197.141998:0:5899:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91907b819e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91906c6fe800 00000004:00080000:3.0:1788581197.142020:0:5899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:3.0:1788581197.142048:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1788581197.142368:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1788581197.142369:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581197.142386:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014266368:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788581197.142435:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581197.142498:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014266368 00000100:00100000:0.0:1788581197.142505:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014266368 00000020:00080000:3.0:1788581197.142522:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788581197.142567:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788581197.142577:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014266368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788581197.142603:0:6723:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1788581197.142640:0:6723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9b9548, atime: 0x6a9b9549, ctime: 0x6a9b9548, blocks: 0xb 00010000:00010000:0.0:1788581197.142648:0:6723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8073c89/0xf54e3944c2a70c18 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.142671:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1788581197.142675:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581197.142682:0:6723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8073c89/0xf54e3944c2a70c18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.142699:0:6723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8073c89/0xf54e3944c2a70c18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.142709:0:6723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8073c89/0xf54e3944c2a70c18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.142717:0:6723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8073c89/0xf54e3944c2a70c18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.142741:0:6723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581197.143052:0:6738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581197.143060:0:6738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8073c89/0xf54e3944c2a70c18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.143069:0:6738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23a00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581197.143074:0:6738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8073c89/0xf54e3944c2a70c18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.143082:0:6738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8073c89/0xf54e3944c2a70c18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.143099:0:6738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8073c89/0xf54e3944c2a70c18 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.143107:0:6738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8073c89/0xf54e3944c2a70c18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.143131:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581197.143133:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581197.143135:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581197.143226:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014266368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 648us (789us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788581197.143234:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788581197.143280:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581197.143398:0:3338:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1788581197.143404:0:3338:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1788581197.143426:0:3338:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff919075b74e00 x1875463014266368/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788581213 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788581197.143438:0:3338:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff919075b74e00/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788581197.143442:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014266368:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788581197.144287:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788581197.144303:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f411ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014266496:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788581197.144362:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581197.145935:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014266496 00000100:00100000:0.0:1788581197.145950:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014266496 00000100:00100000:0.0:1788581197.146070:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788581197.146082:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014266496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788581197.146312:0:10329:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788581197.146315:0:10329:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788581196 00002000:00010000:0.0:1788581197.146318:0:10329:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788581197.146333:0:10329:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788581196 -> 1788581196 00002000:00010000:0.0:1788581197.146335:0:10329:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788581197.146551:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3341:x1875463014266496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 470us (2187us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788581197.146560:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1788581197.146662:0:3341:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff918f411ed180/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788581197.146669:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f411ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014266496:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788581197.146821:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581197.152748:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581197.152888:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995393408 00000100:00100000:3.0:1788581197.152899:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995393408 00000100:00100000:3.0:1788581197.152970:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 55 00000100:00100000:3.0:1788581197.152981:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+10:2374:x1875462995393408:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 00000100:00080000:0.0:1788581197.153102:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581197.216411:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+10:2374:x1875462995393408:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 Request processed in 63420us (63663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581197.216424:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 55 00000001:00080000:0.0:1788581197.216462:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:0.0:1788581197.216474:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1788581197.219584:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581197.219956:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995393664 00000100:00100000:0.0:1788581197.219967:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995393664 00000100:00100000:0.0:1788581197.220032:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 184 00000100:00100000:0.0:1788581197.220042:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:11527:x1875462995393664:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788581197.220096:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581197.220125:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70c03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92c6 expref: 18 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.220141:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919052341d00) 00010000:00010000:0.0:1788581197.220145:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581197.220179:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70c1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.220192:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70c1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.220201:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70c1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581197.220485:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024efd06e reply state 00000000de2184c3 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70c1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581197.220496:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788581197.220592:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:11527:x1875462995393664:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 549us (1015us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788581197.220599:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 184 00010000:00010000:3.0:1788581197.224613:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70c1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.224639:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70c1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.224649:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70c1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.224657:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581197.224664:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70c1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.224692:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70c1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.224717:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919052341d00) 00010000:00010000:3.0:1788581197.224721:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581197.224727:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70c1f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.224733:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70c1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581197.226988:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581197.227056:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995393792 00000100:00100000:3.0:1788581197.227070:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995393792 00000100:00100000:3.0:1788581197.227157:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 56 00000100:00100000:3.0:1788581197.227175:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2373:x1875462995393792:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788581197.227555:0:6725:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788581197.227559:0:6725:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788581196 -> 1788581195 00002000:00010000:3.0:1788581197.227563:0:6725:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788581193 00002000:00010000:3.0:1788581197.227565:0:6725:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788581196 -> 1788581195 00002000:00010000:3.0:1788581197.227568:0:6725:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788581197.227646:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2373:x1875462995393792:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 476us (674us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788581197.227656:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 56 00000100:00100000:2.0:1788581197.241614:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581197.242887:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995394048 00000100:00100000:1.0:1788581197.242899:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995394048 00000100:00100000:1.0:1788581197.242966:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 185 00000100:00100000:1.0:1788581197.242975:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:11527:x1875462995394048:12345-192.168.201.13@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788581197.243045:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70c26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.243061:0:5878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70be7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92b8 expref: 18 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.243070:0:5878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70c26 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.243115:0:5878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70be7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92b8 expref: 18 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.243129:0:5878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70be7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92b8 expref: 18 pid: 9658 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581197.243144:0:5878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5878:1875463014266624:192.168.201.13@tcp:104: 00000100:00100000:1.0:1788581197.243239:0:5878:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581197.253175:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581197.253203:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995394176 00000100:00100000:3.0:1788581197.253212:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995394176 00010000:00010000:3.0:1788581197.253291:0:5862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70be7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92b8 expref: 19 pid: 9658 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581197.253329:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 69 00000100:00100000:3.0:1788581197.253339:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049af0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:2375:x1875462995394176:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581197.253354:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581197.253362:0:5862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70be7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92b8 expref: 19 pid: 9658 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.253376:0:5862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70be7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92b8 expref: 19 pid: 9658 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.253399:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919052341d00) 00010000:00010000:3.0:1788581197.253578:0:5862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70c26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.253590:0:5862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70c26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.253598:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70c26 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.253619:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581197.253678:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049af0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:2375:x1875462995394176:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 340us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581197.253686:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 69 00010000:00010000:1.0:1788581197.254468:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70be7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92b8 expref: 18 pid: 9658 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581197.254485:0:5878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190779cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5878:1875463014266624:192.168.201.13@tcp:104: 00010000:00010000:1.0:1788581197.254506:0:5878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70c26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.254516:0:5878:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70c26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.254522:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70c26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.254550:0:5878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70c26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.254557:0:5878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70c26 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.254564:0:5878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70c26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.254577:0:5878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9c00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581197.254581:0:5878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70c26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.254589:0:5878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70c26 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.254601:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919052341d00) 00010000:00010000:1.0:1788581197.254603:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788581197.254607:0:5878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70c26 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.254613:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9c00/0xf54e3944c2a70c26 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581197.254662:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+17:11527:x1875462995394048:12345-192.168.201.13@tcp:55:lhsmtool_posix.0 Request processed in 11687us (13057us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788581197.254672:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 185 00000100:00100000:2.0:1788581197.265868:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581197.265904:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995394304 00000100:00100000:2.0:1788581197.265914:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995394304 00000100:00100000:2.0:1788581197.265963:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 57 00000100:00100000:2.0:1788581197.265973:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2373:x1875462995394304:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788581197.266017:0:6723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f433478/0xf54e3944c2a70c2d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.266039:0:6723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70c11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92d4 expref: 8 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.266047:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581197.266051:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581197.266054:0:6723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f433478/0xf54e3944c2a70c2d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.266087:0:6723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70c11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92d4 expref: 8 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.266101:0:6723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70c11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92d4 expref: 8 pid: 6725 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581197.266115:0:6723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f411edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6723:1875463014266752:192.168.201.13@tcp:104: 00000100:00100000:2.0:1788581197.266205:0:6723:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f43587840 going to sleep for 11 seconds 00000100:00100000:0.0:1788581197.268899:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581197.268976:0:6723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f411edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6723:1875463014266752:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581197.269002:0:6723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f433478/0xf54e3944c2a70c2d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581197.269418:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995394432 00000100:00100000:1.0:1788581197.269427:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995394432 00010000:00010000:1.0:1788581197.269464:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70c11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92d4 expref: 9 pid: 6725 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581197.269652:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 70 00000100:00100000:1.0:1788581197.269661:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:2375:x1875462995394432:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581197.269676:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581197.269698:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70c11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92d4 expref: 9 pid: 6725 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.271394:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70c11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92d4 expref: 9 pid: 6725 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.271430:0:6739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfe02d20/0xf54e3944c2a70c11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92d4 expref: 9 pid: 6725 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.271447:0:6739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788581197.271452:0:6739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788581197.271458:0:6739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f433478/0xf54e3944c2a70c2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.271468:0:6739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f433478/0xf54e3944c2a70c2d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.271503:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581197.271565:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2375:x1875462995394432:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 1903us (2673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581197.271575:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 70 00010000:00010000:1.0:1788581197.274515:0:6723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f433478/0xf54e3944c2a70c2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.274537:0:6723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f433478/0xf54e3944c2a70c2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.274573:0:6723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f433478/0xf54e3944c2a70c2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.274589:0:6723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f433478/0xf54e3944c2a70c2d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.274597:0:6723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f433478/0xf54e3944c2a70c2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.274604:0:6723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83400 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581197.274609:0:6723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f433478/0xf54e3944c2a70c2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.274619:0:6723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f433478/0xf54e3944c2a70c2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.274637:0:6723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f433478/0xf54e3944c2a70c2d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.274643:0:6723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f433478/0xf54e3944c2a70c2d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581197.275023:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2373:x1875462995394304:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 Request processed in 9046us (9158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581197.275034:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 57 00000100:00100000:3.0:1788581197.279373:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581197.279442:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995394688 00000100:00100000:2.0:1788581197.279453:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995394688 00000100:00100000:2.0:1788581197.279513:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 186 00000100:00100000:2.0:1788581197.279524:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+17:11527:x1875462995394688:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788581197.279598:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.279615:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.279626:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.279842:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c3b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.279853:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70bf5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92bf expref: 18 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.279862:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c3b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.279893:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92bf expref: 18 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.279907:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70bf5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92bf expref: 18 pid: 9658 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581197.279921:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f411eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5877:1875463014266880:192.168.201.13@tcp:104: 00000100:00100000:2.0:1788581197.280002:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f43587840 going to sleep for 11 seconds 00000100:00100000:3.0:1788581197.283545:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581197.283661:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f411eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5877:1875463014266880:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581197.283691:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c3b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581197.283877:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995394816 00000100:00100000:0.0:1788581197.283884:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995394816 00010000:00010000:0.0:1788581197.283919:0:5862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70bf5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92bf expref: 19 pid: 9658 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581197.283986:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 71 00000100:00100000:0.0:1788581197.283996:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:2375:x1875462995394816:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581197.284012:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581197.284019:0:5862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70bf5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92bf expref: 19 pid: 9658 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.284032:0:5862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92bf expref: 19 pid: 9658 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.284054:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70bf5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92bf expref: 19 pid: 9658 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.284071:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919052341d00) 00010000:00010000:0.0:1788581197.284084:0:5862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c3b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.284093:0:5862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.284101:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c3b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.284128:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581197.284180:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:2375:x1875462995394816:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 185us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581197.284187:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 71 00010000:00010000:2.0:1788581197.284234:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.284274:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581197.284457:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1788581197.284590:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1788581197.284629:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1788581197.284711:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f411eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5877:1875463014267008:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788581197.284763:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581197.284807:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f43587000 going to sleep for 11 seconds 00000100:00100000:2.0:1788581197.284830:0:5882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014267008 00000100:00100000:2.0:1788581197.284834:0:5882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014267008 00000100:00100000:2.0:1788581197.284866:0:5882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581197.284873:0:5882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5877:x1875463014267008:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788581197.284937:0:5882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5877:x1875463014267008:12345-0@lo:1000:mdt00_001.0 Request processed in 64us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581197.284943:0:5882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581197.284975:0:5877:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788581197.284981:0:5877:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff918f411ed180, transno 4294967315 00000100:00100000:2.0:1788581197.284992:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f411eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5877:1875463014267008:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788581197.285529:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788581197.285590:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f411eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5877:1875463014267136:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788581197.285621:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581197.285640:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f43587840 going to sleep for 11 seconds 00000100:00100000:2.0:1788581197.285830:0:5882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014267136 00000100:00100000:2.0:1788581197.285835:0:5882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014267136 00000100:00100000:2.0:1788581197.285865:0:5882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788581197.285871:0:5882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5877:x1875463014267136:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788581197.286026:0:5882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5877:x1875463014267136:12345-0@lo:1000:mdt00_001.0 Request processed in 153us (402us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788581197.286034:0:5882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788581197.286067:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f411eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5877:1875463014267136:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788581197.286096:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286107:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c3b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286114:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c3b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286120:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581197.286125:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c3b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286132:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c3b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286147:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919052341d00) 00010000:00010000:2.0:1788581197.286150:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788581197.286161:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c3b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286167:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c3b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286198:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70b70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286205:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70b70 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286211:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70b70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286216:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581197.286219:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70b70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286225:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70b70 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286234:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91904995ad00) 00010000:00010000:2.0:1788581197.286237:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788581197.286239:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70b70 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286270:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70b70 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286291:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c42 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286305:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70b8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92a3 expref: 21 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286319:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c42 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286342:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70b8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92a3 expref: 21 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.286356:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70b8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92a3 expref: 21 pid: 5876 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581197.286368:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f411ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5877:1875463014267264:192.168.201.13@tcp:104: 00000100:00100000:2.0:1788581197.286417:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f43587840 going to sleep for 11 seconds 00000100:00100000:0.0:1788581197.299893:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581197.300023:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995394944 00000100:00100000:1.0:1788581197.300037:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995394944 00010000:00010000:1.0:1788581197.300087:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70b8c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92a3 expref: 22 pid: 5876 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581197.300145:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 72 00000100:00100000:1.0:1788581197.300155:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+22:2374:x1875462995394944:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581197.300170:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581197.300178:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70b8c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92a3 expref: 22 pid: 5876 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.300192:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70b8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92a3 expref: 22 pid: 5876 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.300215:0:6739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91904995ad00) 00010000:00010000:1.0:1788581197.300220:0:6739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c42 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.300230:0:6739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.300238:0:6739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c42 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581197.300367:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581197.300489:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+22:2374:x1875462995394944:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 334us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581197.300497:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 72 00010000:00010000:2.0:1788581197.301044:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70b8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92a3 expref: 21 pid: 5876 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581197.301062:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f411ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5877:1875463014267264:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581197.301083:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.301092:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.301099:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.301111:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.301118:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c42 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.301136:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.301142:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb82a00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581197.301146:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.301156:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c42 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.301168:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91904995ad00) 00010000:00010000:2.0:1788581197.301171:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581197.301175:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c42 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.301181:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c42 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.301192:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.301198:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.301204:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.301209:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581197.301212:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.301227:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.301236:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91904995ad00) 00010000:00010000:2.0:1788581197.301238:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788581197.301908:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581197.301920:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581197.302336:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+20:11527:x1875462995394688:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 22811us (22968us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788581197.302346:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 186 00000020:00080000:2.0:1788581197.302351:0:5877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788581197.302891:0:11735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788581197.302898:0:11735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788581197.304626:0:11735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788581197.304641:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788581197.308559:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581197.308725:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995395200 00000100:00100000:2.0:1788581197.308735:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995395200 00000100:00100000:2.0:1788581197.308803:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:2.0:1788581197.308814:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190673ccc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+20:11527:x1875462995395200:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788581197.309910:0:5880:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788581197.310037:0:5880:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788581197.313608:0:5880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.313633:0:5880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.313645:0:5880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.313653:0:5880:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c49 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.313660:0:5880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c49 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.313666:0:5880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581197.313701:0:5880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788581197.313830:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190673ccc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+22:11527:x1875462995395200:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 5013us (5275us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788581197.313856:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 50 00000020:00080000:3.0:1788581197.313862:0:5880:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788581197.315336:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581197.315349:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.315358:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce000 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581197.315362:0:5865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.315372:0:5865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.315389:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919052341100) 00010000:00010000:0.0:1788581197.315392:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788581197.315396:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c49 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.315402:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581197.315443:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581197.315445:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581197.315447:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581197.871842:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581197.936597:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014267392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581197.936679:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581197.937038:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014267392 00000100:00100000:0.0:1788581197.937046:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014267392 00000100:00100000:0.0:1788581197.937101:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788581197.937111:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3341:x1875463014267392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581197.937138:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788581197.937200:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3341:x1875463014267392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581197.937205:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788581197.937284:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014267392:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788581198.895493:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788581199.057301:0:12509:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788581199.057310:0:12509:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788581199.057342:0:12509:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788581199.057347:0:12509:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788581199.282971:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581199.283116:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995395456 00000100:00100000:2.0:1788581199.283126:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995395456 00000100:00100000:2.0:1788581199.283206:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 187 00000100:00100000:2.0:1788581199.283216:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+22:11545:x1875462995395456:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1788581199.283268:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581199.283288:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d92db expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.283408:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c57 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.283423:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.283435:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581199.283447:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788581199.283579:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92db expref: 25 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.283597:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92db expref: 24 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.283607:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:2.0:1788581199.283610:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788581199.283613:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb82a00, rc 0) 00000100:00100000:2.0:1788581199.283674:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+24:11545:x1875462995395456:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 459us (713us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788581199.283681:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 187 00000100:00080000:0.0:1788581199.284138:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581199.298958:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581199.313317:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995395584 00000100:00100000:3.0:1788581199.313331:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995395584 00000100:00100000:3.0:1788581199.313401:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 188 00000100:00100000:3.0:1788581199.313410:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+24:11545:x1875462995395584:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:3.0:1788581199.313489:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c65 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313505:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313517:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313531:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70c6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313538:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70c6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313545:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70c6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313814:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70c73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313829:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70c73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313837:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70c73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581199.313876:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70c73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313888:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313895:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c65 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313902:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313908:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581199.313912:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313919:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313931:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:3.0:1788581199.313934:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581199.313938:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313944:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70c65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313962:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70c6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313969:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70c6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313974:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70c6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313979:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581199.313982:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70c6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313988:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70c6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.313994:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919052341800) 00010000:00010000:3.0:1788581199.313997:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581199.313999:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70c6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.314005:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70c6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.314017:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70c73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.314023:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70c73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.314029:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70c73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.314038:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581199.314041:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70c73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.314047:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70c73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.314053:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919052341200) 00010000:00010000:3.0:1788581199.314055:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581199.314058:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70c73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.314064:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70c73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581199.315017:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+24:11545:x1875462995395584:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 1599us (16062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581199.315028:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 188 00000100:00100000:3.0:1788581199.388852:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581199.388935:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995395840 00000100:00100000:2.0:1788581199.388946:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995395840 00000100:00100000:2.0:1788581199.389009:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 189 00000100:00100000:2.0:1788581199.389020:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+24:11548:x1875462995395840:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1788581199.389042:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581199.389096:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d92e2 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.389171:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70c81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.389184:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70c81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.389194:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70c81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.389218:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70c88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.389225:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.389231:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390116:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390128:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390136:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581199.390146:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788581199.390266:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70c81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390284:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70c81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390291:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70c81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390297:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581199.390302:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70c81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390309:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70c81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390322:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:2.0:1788581199.390325:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581199.390329:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70c81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390336:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70c81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390348:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390354:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70c88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390359:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70c88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390374:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581199.390381:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70c88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390388:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70c88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390396:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91905c525000) 00010000:00010000:2.0:1788581199.390398:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581199.390401:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70c88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390407:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70c88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390448:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70c7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e2 expref: 27 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390460:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e2 expref: 26 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.390467:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c525e00) 00010000:00010000:2.0:1788581199.390469:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581199.390472:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb83000, rc 0) 00000100:00100000:2.0:1788581199.390550:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+26:11548:x1875462995395840:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1531us (1708us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788581199.390557:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 189 00000100:00100000:3.0:1788581199.396277:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581199.396366:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995395968 00000100:00100000:0.0:1788581199.396376:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995395968 00000100:00100000:0.0:1788581199.396431:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 190 00000100:00100000:0.0:1788581199.396442:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+26:11548:x1875462995395968:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:0.0:1788581199.396516:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70c9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.396533:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70c9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.396545:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70c9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.396570:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70c9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.396590:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70c9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.396597:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70c9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.396602:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581199.396607:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70c9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.396614:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70c9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.396626:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c525e00) 00010000:00010000:0.0:1788581199.396629:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581199.396632:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70c9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.396649:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70c9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581199.396722:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+26:11548:x1875462995395968:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 282us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.396730:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 190 00000100:00100000:0.0:1788581199.400807:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581199.400934:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995396224 00000100:00100000:1.0:1788581199.400944:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995396224 00000100:00100000:1.0:1788581199.401003:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 51 00000100:00100000:1.0:1788581199.401014:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+26:11548:x1875462995396224:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:1.0:1788581199.401297:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+27:11548:x1875462995396224:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 284us (500us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788581199.401305:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 51 00000100:00100000:3.0:1788581199.467127:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581199.467281:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995396480 00000100:00100000:1.0:1788581199.467291:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995396480 00000100:00100000:1.0:1788581199.467353:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 191 00000100:00100000:1.0:1788581199.467596:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+27:11074:x1875462995396480:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1788581199.467685:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581199.467710:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70ca4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d92e9 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.467829:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70cab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.467846:0:5878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e2 expref: 28 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.467872:0:5878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70cab lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.467907:0:5878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e2 expref: 28 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.467920:0:5878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e2 expref: 28 pid: 9658 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581199.467935:0:5878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5878:1875463014267520:192.168.201.13@tcp:104: 00000100:00100000:3.0:1788581199.468044:0:5878:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f4118c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581199.471481:0:5878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5878:1875463014267520:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581199.471513:0:5878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70cab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581199.477039:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581199.477949:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995396608 00000100:00100000:3.0:1788581199.477959:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995396608 00010000:00010000:3.0:1788581199.478004:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e2 expref: 29 pid: 9658 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581199.478060:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 73 00000100:00100000:3.0:1788581199.478071:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+29:2375:x1875462995396608:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581199.478085:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581199.478091:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e2 expref: 29 pid: 9658 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.478123:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e2 expref: 29 pid: 9658 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.478145:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70c8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e2 expref: 29 pid: 9658 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.478162:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c525e00) 00010000:00010000:3.0:1788581199.478167:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70cab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.478177:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70cab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.478186:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70cab lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.478214:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581199.478286:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+28:2375:x1875462995396608:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 216us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581199.478295:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 73 00010000:00010000:3.0:1788581199.478324:0:5878:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70cab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.478333:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70cab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581199.478353:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788581199.478513:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70ca4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e9 expref: 29 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.478541:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70cab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e9 expref: 28 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.478548:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c525e00) 00010000:00010000:3.0:1788581199.478551:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788581199.478553:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce400, rc 0) 00000100:00100000:3.0:1788581199.478580:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+28:11074:x1875462995396480:12345-192.168.201.13@tcp:101:bash.0 Request processed in 11219us (11464us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788581199.478587:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 191 00000100:00100000:0.0:1788581199.488993:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581199.489172:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995396864 00000100:00100000:3.0:1788581199.489185:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995396864 00000100:00100000:3.0:1788581199.489290:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 192 00000100:00100000:3.0:1788581199.489302:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+28:11074:x1875462995396864:12345-192.168.201.13@tcp:36:bash.0 00010000:00010000:3.0:1788581199.489571:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70cb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.489589:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.489601:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788581199.490062:0:5876:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788581199.490092:0:5876:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c023444 reply state 00000000ec402825 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581199.490102:0:5876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788581199.490174:0:5876:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788581199.490302:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+32:11074:x1875462995396864:12345-192.168.201.13@tcp:36:bash.0 Request processed in 999us (1318us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788581199.490309:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 192 00000020:00080000:3.0:1788581199.490314:0:5876:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788581199.494395:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581199.494484:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995396992 00000100:00100000:2.0:1788581199.494494:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995396992 00000100:00100000:2.0:1788581199.494551:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 193 00000100:00100000:2.0:1788581199.494562:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+32:11074:x1875462995396992:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:2.0:1788581199.494599:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581199.494619:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70cc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d92f0 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.494679:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92f0 expref: 33 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.494694:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92f0 expref: 33 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.494715:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c525e00) 00010000:00010000:2.0:1788581199.494719:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788581199.494723:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb83800, rc 0) 00000100:00100000:2.0:1788581199.494794:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+33:11074:x1875462995396992:12345-192.168.201.13@tcp:101:bash.0 Request processed in 233us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581199.494800:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 193 00000100:00100000:3.0:1788581199.497967:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581199.498126:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995397120 00000100:00100000:0.0:1788581199.498158:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995397120 00000100:00100000:0.0:1788581199.498234:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 58 00000100:00100000:0.0:1788581199.498273:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:11074:x1875462995397120:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:0.0:1788581199.498290:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581199.498310:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a70cc7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d92f7 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788581199.498336:0:6725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9b954b, atime: 0x6a9b9549, ctime: 0x6a9b954b, blocks: 0xb 00010000:00010000:0.0:1788581199.498355:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=415s v=(0 0) 00010000:00010000:0.0:1788581199.498359:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581199.498367:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a70cc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92f7 expref: 8 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.498382:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a70cc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92f7 expref: 8 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.498397:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22800, rc 0) 00000100:00100000:0.0:1788581199.498465:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:11074:x1875462995397120:12345-192.168.201.13@tcp:101:bash.0 Request processed in 223us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.498473:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 58 00000100:00080000:2.0:1788581199.498646:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581199.502768:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581199.502920:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995397248 00000100:00100000:2.0:1788581199.502931:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995397248 00002000:00010000:2.0:1788581199.502978:0:6728:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788581199.502983:0:6728:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91906c96dc00 with x1875462995397248 ext(0->18446744073709551615) 00002000:00010000:2.0:1788581199.502996:0:6728:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91906c96dc00. 00000100:00100000:2.0:1788581199.503035:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:2.0:1788581199.503046:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2375:x1875462995397248:12345-192.168.201.13@tcp:10:bash.0 00002000:00010000:2.0:1788581199.503408:0:6728:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788581199.503413:0:6728:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788581195 -> 1788581199 00002000:00010000:2.0:1788581199.503416:0:6728:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788581193 -> 1788581193 00002000:00010000:2.0:1788581199.503447:0:6728:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788581195 -> 1788581199 00002000:00010000:2.0:1788581199.503450:0:6728:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788581199.503502:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:2375:x1875462995397248:12345-192.168.201.13@tcp:10:bash.0 Request processed in 457us (763us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788581199.503510:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 5 00002000:00010000:2.0:1788581199.503514:0:6728:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788581199.503516:0:6728:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91906c96dc00 with x1875462995397248 ext(0->18446744073709551615) 00002000:00010000:2.0:1788581199.503522:0:6728:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91906c96dc00. 00010000:00010000:1.0:1788581199.507221:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.507241:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70cb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.507263:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70cb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.507269:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cec00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581199.507274:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70cb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.507281:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70cb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.507300:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c525e00) 00010000:00010000:1.0:1788581199.507302:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581199.507326:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70cb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.507332:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cec00/0xf54e3944c2a70cb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581199.623854:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581199.624122:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995397376 00000100:00100000:2.0:1788581199.624132:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995397376 00000100:00100000:2.0:1788581199.624203:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 194 00000100:00100000:2.0:1788581199.624215:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+32:11562:x1875462995397376:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:2.0:1788581199.624324:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cce lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.624342:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.624354:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.624370:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.624377:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.624383:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.624642:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70cdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.624653:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70cdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.624660:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70cdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581199.624701:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70cdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.624711:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.624717:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.624724:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.624730:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581199.624733:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.624752:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.625010:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:2.0:1788581199.625014:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581199.625019:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.625033:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.625047:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.625053:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.625060:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.625065:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581199.625069:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.625074:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.625081:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91905c525000) 00010000:00010000:2.0:1788581199.625083:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581199.625086:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cd5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.625092:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.625105:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70cdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.625111:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70cdc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.625123:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70cdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.625128:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83a00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581199.625131:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70cdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.625137:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70cdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.625145:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c525e00) 00010000:00010000:2.0:1788581199.625148:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581199.625151:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70cdc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.625156:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70cdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581199.625282:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+32:11562:x1875462995397376:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 1026us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581199.625291:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 194 00000100:00100000:0.0:1788581199.672822:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581199.672951:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995397632 00000100:00100000:2.0:1788581199.672960:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995397632 00000100:00100000:2.0:1788581199.673017:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 195 00000100:00100000:2.0:1788581199.673026:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+32:11565:x1875462995397632:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1788581199.673046:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581199.673065:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70ce3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d92fe expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673169:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673183:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673194:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673208:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673215:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673222:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673485:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70cf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673494:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673501:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581199.673511:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788581199.673592:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673600:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673612:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673618:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581199.673622:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673629:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673641:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:2.0:1788581199.673644:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581199.673647:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673653:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70cea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673665:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673672:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cf1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673678:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673682:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581199.673685:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673700:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673708:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91905c525000) 00010000:00010000:2.0:1788581199.673710:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581199.673713:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cf1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673719:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70cf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673775:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70ce3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92fe expref: 35 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673789:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92fe expref: 34 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.673796:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c525e00) 00010000:00010000:2.0:1788581199.673798:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788581199.673800:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bb83000, rc 0) 00000100:00100000:2.0:1788581199.673868:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+34:11565:x1875462995397632:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 842us (1056us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788581199.673875:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 195 00000100:00100000:0.0:1788581199.678303:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581199.678391:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995397760 00000100:00100000:3.0:1788581199.678402:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995397760 00000100:00100000:3.0:1788581199.678469:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 196 00000100:00100000:3.0:1788581199.678479:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+34:11565:x1875462995397760:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:3.0:1788581199.678554:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70d06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.678573:0:5876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70cab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e9 expref: 34 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.678583:0:5876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70d06 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.678615:0:5876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70cab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e9 expref: 34 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.678629:0:5876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70cab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e9 expref: 34 pid: 5878 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581199.678643:0:5876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5876:1875463014267648:192.168.201.13@tcp:104: 00000100:00100000:3.0:1788581199.678733:0:5876:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f4118c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581199.682048:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581199.682138:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995398016 00000100:00100000:1.0:1788581199.682146:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995398016 00000100:00100000:1.0:1788581199.682220:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 52 00000100:00100000:1.0:1788581199.682230:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+35:9972:x1875462995398016:12345-192.168.201.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788581199.682568:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+36:9972:x1875462995398016:12345-192.168.201.13@tcp:35:ldlm_bl.0 Request processed in 338us (529us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788581199.682577:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 52 00000100:00100000:3.0:1788581199.682727:0:5876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5876:1875463014267648:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581199.682765:0:5876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70d06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581199.685376:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581199.685772:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995398144 00000100:00100000:1.0:1788581199.685782:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995398144 00010000:00010000:1.0:1788581199.685846:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70cab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e9 expref: 36 pid: 5878 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.685887:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 74 00000100:00100000:1.0:1788581199.685898:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+36:2374:x1875462995398144:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581199.685913:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581199.685920:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70cab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e9 expref: 36 pid: 5878 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.685935:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70cab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e9 expref: 36 pid: 5878 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.685957:0:6739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce400/0xf54e3944c2a70cab lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92e9 expref: 36 pid: 5878 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.686002:0:6739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c525e00) 00010000:00010000:1.0:1788581199.686007:0:6739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70d06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.686017:0:6739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70d06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.686024:0:6739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70d06 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.686064:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581199.686130:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+35:2374:x1875462995398144:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 233us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581199.686138:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 74 00010000:00010000:3.0:1788581199.687384:0:5876:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70d06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.687397:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70d06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.687463:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70d06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.687470:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70d06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.687477:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70d06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.687483:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581199.687488:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70d06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.687496:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70d06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.687511:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c525e00) 00010000:00010000:3.0:1788581199.687514:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581199.687519:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70d06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.687524:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70d06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581199.687606:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+34:11565:x1875462995397760:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 9125us (9312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581199.687628:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 196 00000100:00100000:0.0:1788581199.691127:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581199.691297:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995398400 00000100:00100000:1.0:1788581199.691307:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995398400 00000100:00100000:1.0:1788581199.691360:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 53 00000100:00100000:1.0:1788581199.691370:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+34:11565:x1875462995398400:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:1.0:1788581199.691965:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+35:11565:x1875462995398400:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 593us (845us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788581199.691974:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 53 00000100:00100000:0.0:1788581199.809654:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581199.809777:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995398656 00000100:00100000:2.0:1788581199.809788:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995398656 00000100:00100000:2.0:1788581199.809849:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 197 00000100:00100000:2.0:1788581199.809859:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+35:11577:x1875462995398656:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:2.0:1788581199.809902:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581199.809926:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70d0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9305 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810000:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70d14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810014:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70d14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810027:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70d14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810041:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70d1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810049:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810055:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810368:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a70d22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810379:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a70d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810387:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a70d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581199.810398:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788581199.810489:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70d14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810498:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70d14 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810505:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70d14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810511:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581199.810515:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70d14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810523:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70d14 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810535:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:2.0:1788581199.810538:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581199.810542:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70d14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810548:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83200/0xf54e3944c2a70d14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810561:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810567:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70d1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810574:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70d1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810579:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83a00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581199.810588:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70d1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810593:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70d1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810601:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91905c525000) 00010000:00010000:2.0:1788581199.810604:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581199.810607:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70d1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810614:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83a00/0xf54e3944c2a70d1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810652:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83400/0xf54e3944c2a70d0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9305 expref: 38 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810665:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a70d22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9305 expref: 37 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.810673:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c525e00) 00010000:00010000:2.0:1788581199.810675:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581199.810677:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91906cb63400, rc 0) 00000100:00100000:2.0:1788581199.810758:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+37:11577:x1875462995398656:12345-192.168.201.13@tcp:101:cat.0 Request processed in 900us (1114us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788581199.810766:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 197 00000100:00100000:2.0:1788581199.822783:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581199.824745:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995398912 00000100:00100000:3.0:1788581199.824761:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995398912 00000100:00100000:3.0:1788581199.824903:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 54 00000100:00100000:3.0:1788581199.824915:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+37:11577:x1875462995398912:12345-192.168.201.13@tcp:35:cat.0 00000100:00100000:3.0:1788581199.825170:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+38:11577:x1875462995398912:12345-192.168.201.13@tcp:35:cat.0 Request processed in 258us (2397us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788581199.825178:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 54 00000100:00100000:0.0:1788581199.849683:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581199.849912:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995399168 00000100:00100000:2.0:1788581199.849923:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995399168 00000100:00100000:2.0:1788581199.850028:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 198 00000100:00100000:2.0:1788581199.850058:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+38:11578:x1875462995399168:12345-192.168.201.13@tcp:36:rm.0 00010000:00010000:2.0:1788581199.850123:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788581199.850151:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a70d22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9305 expref: 38 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.850174:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83000/0xf54e3944c2a70cf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92fe expref: 37 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.850186:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb83800/0xf54e3944c2a70cc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92f0 expref: 36 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.850195:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c525e00) 00010000:00010000:2.0:1788581199.850207:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581199.850228:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63a00/0xf54e3944c2a70d30 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.850274:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63a00/0xf54e3944c2a70d30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.850285:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63a00/0xf54e3944c2a70d30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.850300:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a70d37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.850308:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a70d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.850314:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a70d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.850565:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62200/0xf54e3944c2a70d3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.850574:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62200/0xf54e3944c2a70d3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.850581:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62200/0xf54e3944c2a70d3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788581199.851120:0:5877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788581199.851130:0:5877:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 416091885950ns, next at 417091883720ns, rc = 0 00010000:00010000:2.0:1788581199.851184:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62000/0xf54e3944c2a70d45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851194:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62000/0xf54e3944c2a70d45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851202:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62000/0xf54e3944c2a70d45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851209:0:5877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62000/0xf54e3944c2a70d45 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851216:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62000/0xf54e3944c2a70d45 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851222:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62000/0xf54e3944c2a70d45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851237:0:5877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581199.851275:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62200/0xf54e3944c2a70d3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851287:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62200/0xf54e3944c2a70d3e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851294:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62200/0xf54e3944c2a70d3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851299:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb62200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581199.851304:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62200/0xf54e3944c2a70d3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851311:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62200/0xf54e3944c2a70d3e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851321:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c525900) 00010000:00010000:2.0:1788581199.851324:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788581199.851327:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62200/0xf54e3944c2a70d3e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851334:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62200/0xf54e3944c2a70d3e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851349:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63a00/0xf54e3944c2a70d30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851355:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63a00/0xf54e3944c2a70d30 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851361:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63a00/0xf54e3944c2a70d30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851366:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb63a00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581199.851372:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63a00/0xf54e3944c2a70d30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851379:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63a00/0xf54e3944c2a70d30 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851386:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:2.0:1788581199.851389:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581199.851391:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63a00/0xf54e3944c2a70d30 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.851397:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63a00/0xf54e3944c2a70d30 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788581199.851406:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c9aaa57 reply state 00000000bcf9f328 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a70d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581199.851415:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788581199.851761:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581199.851768:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62000/0xf54e3944c2a70d45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.851774:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb62000 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581199.851777:0:5865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62000/0xf54e3944c2a70d45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.851784:0:5865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62000/0xf54e3944c2a70d45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.851792:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905c525900) 00010000:00010000:0.0:1788581199.851794:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788581199.851797:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62000/0xf54e3944c2a70d45 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.851804:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62000/0xf54e3944c2a70d45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.851819:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581199.851821:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581199.851823:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581199.852169:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+37:11578:x1875462995399168:12345-192.168.201.13@tcp:36:rm.0 Request processed in 2109us (2491us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788581199.852179:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 198 00010000:00010000:3.0:1788581199.858061:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a70d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.858081:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a70d37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.858089:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a70d37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.858096:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb62e00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581199.858101:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a70d37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.858109:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a70d37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.858128:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91905c525000) 00010000:00010000:3.0:1788581199.858132:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581199.858137:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a70d37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.858174:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a70d37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581199.921391:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581199.921543:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995399424 00000100:00100000:3.0:1788581199.921552:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995399424 00000100:00100000:3.0:1788581199.921613:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 199 00000100:00100000:3.0:1788581199.921625:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+36:11584:x1875462995399424:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1788581199.921661:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581199.921681:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70d4c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d930c expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.921817:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70d53 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.921832:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70d53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.921843:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70d53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.921857:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70d5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.921864:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70d5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.921870:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70d5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788581199.922382:0:9658:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788581199.922550:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70d61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.922561:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70d61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.922569:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70d61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.922602:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70d53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.922610:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70d53 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.922616:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70d53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.922622:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581199.922626:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70d53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.922633:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70d53 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.922644:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:3.0:1788581199.922647:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581199.922651:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70d53 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.922656:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70d53 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581199.922680:0:9658:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fe67b1e reply state 00000000743a69a3 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70d5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581199.922688:0:9658:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788581199.922714:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70d4c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d930c expref: 39 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.922727:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70d61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d930c expref: 38 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.922747:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341000) 00010000:00010000:3.0:1788581199.922750:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581199.922752:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cee00, rc 0) 00010000:00010000:2.0:1788581199.923056:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581199.923669:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+39:11584:x1875462995399424:12345-192.168.201.13@tcp:101:bash.0 Request processed in 2042us (2286us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788581199.923678:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 199 00000100:00100000:0.0:1788581199.927570:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581199.927634:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995399552 00000100:00100000:3.0:1788581199.927644:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995399552 00000100:00100000:3.0:1788581199.927711:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 59 00000100:00100000:3.0:1788581199.927721:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995399552:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1788581199.927747:0:6722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581199.927774:0:6722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b01b63a/0xf54e3944c2a70d6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9313 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581199.927798:0:6722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581199.927815:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1788581199.927830:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581199.927840:0:6722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b01b63a/0xf54e3944c2a70d6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9313 expref: 6 pid: 6722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.927860:0:6722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002b01b63a/0xf54e3944c2a70d6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9313 expref: 6 pid: 6722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581199.927873:0:6722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce600, rc 0) 00000100:00100000:3.0:1788581199.927924:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995399552:12345-192.168.201.13@tcp:101:bash.0 Request processed in 205us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581199.927930:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 59 00000100:00080000:0.0:1788581199.928186:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788581199.929616:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70d5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.929632:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70d5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.929638:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70d5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.929643:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581199.929663:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70d5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.929670:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70d5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.929686:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919052341800) 00010000:00010000:2.0:1788581199.929689:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581199.929694:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70d5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581199.929700:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70d5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.930535:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581199.930615:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995399680 00000100:00100000:0.0:1788581199.930625:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995399680 00000100:00100000:0.0:1788581199.930676:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 60 00000100:00100000:0.0:1788581199.930685:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:11584:x1875462995399680:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:0.0:1788581199.930711:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581199.930726:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a70d76 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d931a expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.930776:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002b01b63a/0xf54e3944c2a70d6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9313 expref: 7 pid: 6722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.930785:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581199.930790:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581199.930795:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a70d76 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d931a expref: 7 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.930828:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002b01b63a/0xf54e3944c2a70d6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9313 expref: 7 pid: 6722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.930842:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002b01b63a/0xf54e3944c2a70d6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9313 expref: 7 pid: 6722 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581199.930857:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c96ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6725:1875463014267776:192.168.201.13@tcp:104: 00000100:00100000:0.0:1788581199.930965:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f4357f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788581199.935068:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581199.935223:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c96ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6725:1875463014267776:192.168.201.13@tcp:104: 00010000:00010000:0.0:1788581199.935303:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a70d76 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d931a expref: 7 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581199.935323:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22600, rc 0) 00000100:00100000:0.0:1788581199.935405:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:11584:x1875462995399680:12345-192.168.201.13@tcp:101:bash.0 Request processed in 4720us (4875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581199.935414:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 60 00000100:00100000:1.0:1788581199.935964:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995399808 00000100:00100000:1.0:1788581199.935974:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995399808 00010000:00010000:1.0:1788581199.936008:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002b01b63a/0xf54e3944c2a70d6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9313 expref: 7 pid: 6722 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.936052:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 75 00000100:00100000:1.0:1788581199.936059:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2375:x1875462995399808:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581199.936069:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581199.936089:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002b01b63a/0xf54e3944c2a70d6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9313 expref: 7 pid: 6722 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.936102:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002b01b63a/0xf54e3944c2a70d6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9313 expref: 7 pid: 6722 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.936127:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b01b63a/0xf54e3944c2a70d6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9313 expref: 7 pid: 6722 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.936139:0:5861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581199.936143:0:5861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581199.936157:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a70d76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d931a expref: 6 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.936165:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a70d76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d931a expref: 6 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581199.936192:0:5861:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a70d76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d931a expref: 6 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581199.936202:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076315f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5861:1875463014267904:192.168.201.13@tcp:105: 00000100:00100000:1.0:1788581199.936296:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581199.940313:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581199.940480:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076315f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5861:1875463014267904:192.168.201.13@tcp:105: 00010000:00010000:1.0:1788581199.940504:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581199.940555:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2375:x1875462995399808:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 4495us (5498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581199.940567:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 75 00000100:00100000:0.0:1788581199.941026:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995400064 00000100:00100000:0.0:1788581199.941036:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995400064 00000100:00100000:0.0:1788581199.941084:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 55 00000100:00100000:0.0:1788581199.941093:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+38:11584:x1875462995400064:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:0.0:1788581199.941477:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+39:11584:x1875462995400064:12345-192.168.201.13@tcp:35:bash.0 Request processed in 383us (1173us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788581199.941484:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 55 00000100:00100000:3.0:1788581200.131997:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581200.132121:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995400192 00000100:00100000:0.0:1788581200.132130:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995400192 00000100:00100000:0.0:1788581200.132213:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 200 00000100:00100000:0.0:1788581200.132223:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+39:11600:x1875462995400192:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1788581200.132284:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581200.132307:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70d7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9321 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.132373:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70d84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.132387:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70d84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.132398:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70d84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581200.132433:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788581200.132450:0:5876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788581200.132471:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70d84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.132495:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70d7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9321 expref: 41 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.132514:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70d84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9321 expref: 40 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.132524:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:0.0:1788581200.132527:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581200.132531:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22200, rc 0) 00000100:00100000:0.0:1788581200.132598:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+40:11600:x1875462995400192:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 376us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581200.132605:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 200 00000100:00100000:1.0:1788581200.138663:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581200.138767:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995400448 00000100:00100000:0.0:1788581200.138777:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995400448 00000100:00100000:0.0:1788581200.138839:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 201 00000100:00100000:0.0:1788581200.138849:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+40:11600:x1875462995400448:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1788581200.138871:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581200.138892:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70d8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9328 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.139000:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70d92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.139014:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.139045:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581200.139058:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788581200.139205:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70d8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9328 expref: 43 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.139223:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70d92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9328 expref: 42 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.139232:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341000) 00010000:00010000:0.0:1788581200.139234:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581200.139238:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc23600, rc 0) 00000100:00100000:0.0:1788581200.139502:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+42:11600:x1875462995400448:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 653us (849us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788581200.139510:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 201 00000100:00100000:1.0:1788581200.144798:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581200.146544:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581200.146640:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995400832 00000100:00100000:2.0:1788581200.146649:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995400832 00000100:00100000:2.0:1788581200.146723:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:2.0:1788581200.146743:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049af0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+42:2375:x1875462995400832:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581200.146767:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581200.146792:0:6739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70d92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9328 expref: 42 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581200.146813:0:6739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341000) 00010000:00010000:2.0:1788581200.146818:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581200.146880:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049af0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+41:2375:x1875462995400832:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 147us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581200.146888:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:0.0:1788581200.147779:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995400704 00000100:00100000:0.0:1788581200.147787:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995400704 00000100:00100000:0.0:1788581200.147831:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 202 00000100:00100000:0.0:1788581200.147839:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+41:11600:x1875462995400704:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1788581200.147862:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581200.147882:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70da0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d932f expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.147978:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70da7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.148012:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70da7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.148024:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70da7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581200.148038:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788581200.148409:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70da0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d932f expref: 44 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.148426:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70da7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d932f expref: 43 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.148435:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341000) 00010000:00010000:0.0:1788581200.148437:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788581200.148441:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc23800, rc 0) 00000100:00100000:0.0:1788581200.148530:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+43:11600:x1875462995400704:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 692us (3742us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788581200.148538:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 202 00000100:00100000:1.0:1788581200.157982:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581200.158426:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995400960 00000100:00100000:3.0:1788581200.158435:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995400960 00000100:00100000:3.0:1788581200.158493:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 61 00000100:00100000:3.0:1788581200.158503:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904a0f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+6:2374:x1875462995400960:12345-192.168.201.13@tcp:1:lfs.0 00010000:00010000:3.0:1788581200.158544:0:6722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a70db5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.158565:0:6722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a70d76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d931a expref: 6 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.158573:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581200.158578:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788581200.158582:0:6722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a70db5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.158630:0:6722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a70d76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d931a expref: 6 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.158645:0:6722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a70d76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d931a expref: 6 pid: 6725 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581200.158660:0:6722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f716680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6722:1875463014268032:192.168.201.13@tcp:104: 00000100:00100000:3.0:1788581200.158771:0:6722:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f4118c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581200.162114:0:6722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f716680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6722:1875463014268032:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581200.162158:0:6722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a70db5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581200.164299:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581200.164432:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995401088 00000100:00100000:2.0:1788581200.164443:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995401088 00002000:00100000:2.0:1788581200.164514:0:6729:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff919076314700 x1875462995401088/t0(0) o4->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:556/0 lens 504/0 e 0 to 0 dl 1788581211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788581200.164525:0:6729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff919076314700 with x1875462995401088 ext(0->8) 00010000:00010000:2.0:1788581200.164535:0:6729:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a70d76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d931a expref: 7 pid: 6725 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581200.164552:0:6729:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a70d76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d931a expref: 7 pid: 6725 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788581200.164560:0:6729:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff919076314700 00000100:00100000:2.0:1788581200.164632:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:2.0:1788581200.164642:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2375:x1875462995401088:12345-192.168.201.13@tcp:4:lfs.0 00000100:00100000:2.0:1788581200.165111:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:2375:x1875462995401088:12345-192.168.201.13@tcp:4:lfs.0 Request processed in 469us (819us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788581200.165120:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 3 00002000:00100000:2.0:1788581200.165127:0:6729:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff919076314700 x1875462995401088/t4294967308(0) o4->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:556/0 lens 504/448 e 0 to 0 dl 1788581211 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788581200.165136:0:6729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff919076314700 with x1875462995401088 ext(0->8) 00010000:00010000:2.0:1788581200.165151:0:6729:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a70d76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d931a expref: 9 pid: 6725 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581200.165518:0:6729:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a70d76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d931a expref: 9 pid: 6725 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788581200.165528:0:6729:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff919076314700 00000100:00100000:1.0:1788581200.169371:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581200.169532:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995401216 00000100:00100000:2.0:1788581200.169543:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995401216 00010000:00010000:2.0:1788581200.169583:0:5862:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a70d76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d931a expref: 9 pid: 6725 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581200.169666:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 76 00000100:00100000:2.0:1788581200.169677:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076317100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:2374:x1875462995401216:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581200.169695:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788581200.169716:0:5862:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788581200.169719:0:5862:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788581199 00002000:00010000:2.0:1788581200.169721:0:5862:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788581199 00002000:00010000:2.0:1788581200.169723:0:5862:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788581199 00010000:00010000:2.0:1788581200.169739:0:5862:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a70d76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d931a expref: 9 pid: 6725 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581200.169763:0:5862:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a70d76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d931a expref: 9 pid: 6725 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581200.169789:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003678ecdb/0xf54e3944c2a70d76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d931a expref: 9 pid: 6725 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581200.169807:0:5862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581200.169811:0:5862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581200.169817:0:5862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a70db5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581200.169827:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a70db5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581200.169876:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581200.169941:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076317100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2374:x1875462995401216:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 265us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581200.169949:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 76 00010000:00010000:3.0:1788581200.170013:0:6722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a70db5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.170022:0:6722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a70db5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.170049:0:6722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a70db5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.170057:0:6722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a70db5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.170077:0:6722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a70db5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.170083:0:6722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581200.170087:0:6722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a70db5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.170096:0:6722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a70db5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.170108:0:6722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a70db5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.170115:0:6722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a70db5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581200.170185:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904a0f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2374:x1875462995400960:12345-192.168.201.13@tcp:1:lfs.0 Request processed in 11683us (12213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581200.170193:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 61 00000100:00100000:0.0:1788581200.173854:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581200.173961:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995401472 00000100:00100000:1.0:1788581200.173971:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995401472 00000100:00100000:1.0:1788581200.174062:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 56 00000100:00100000:1.0:1788581200.174073:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190673cdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+43:11600:x1875462995401472:12345-192.168.201.13@tcp:35:lfs.0 00000004:00010000:1.0:1788581200.174138:0:5879:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70da7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d932f expref: 43 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788581200.174550:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788581200.174592:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788581200.174903:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788581200.174955:0:5879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70dbc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581200.174970:0:5879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70d61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d930c expref: 47 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581200.174996:0:5879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70dbc lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581200.175032:0:5879:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70d61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d930c expref: 47 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581200.175049:0:5879:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70d61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d930c expref: 47 pid: 9658 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581200.175064:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076315180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5879:1875463014268160:192.168.201.13@tcp:104: 00000100:00100000:1.0:1788581200.175506:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581200.185011:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581200.185117:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995401600 00000100:00100000:3.0:1788581200.185128:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995401600 00010000:00010000:3.0:1788581200.185314:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70d61 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d930c expref: 48 pid: 9658 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581200.185348:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 77 00000100:00100000:3.0:1788581200.185373:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+48:2374:x1875462995401600:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581200.185388:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581200.185396:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70d61 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d930c expref: 48 pid: 9658 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.185410:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70d61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d930c expref: 48 pid: 9658 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.185558:0:6739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341000) 00010000:00010000:3.0:1788581200.185565:0:6739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70dbc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.185575:0:6739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70dbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.185583:0:6739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70dbc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.185602:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581200.185659:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+48:2374:x1875462995401600:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 288us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581200.185668:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 77 00010000:00010000:2.0:1788581200.187356:0:5879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70d61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d930c expref: 47 pid: 9658 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581200.187381:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076315180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5879:1875463014268160:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581200.187406:0:5879:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70dbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581200.187416:0:5879:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70dbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581200.187422:0:5879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70dbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581200.187871:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788581200.188083:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1788581200.190344:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f411ed500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5879:1875463014268288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788581200.190409:0:5879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581200.190518:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f43587e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581200.190651:0:5882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014268288 00000100:00100000:0.0:1788581200.190658:0:5882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014268288 00000100:00100000:0.0:1788581200.190785:0:5882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788581200.190795:0:5882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5879:x1875463014268288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788581200.190873:0:5882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5879:x1875463014268288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 80us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581200.190880:0:5882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581200.190958:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f411ed500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5879:1875463014268288:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788581200.191456:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788581200.191519:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076315880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5879:1875463014268416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788581200.191547:0:5879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788581200.191888:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581200.192004:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190485c7780 going to sleep for 11 seconds 00000100:00100000:3.0:1788581200.192040:0:5881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014268416 00000100:00100000:3.0:1788581200.192046:0:5881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014268416 00000100:00100000:3.0:1788581200.192082:0:5881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788581200.192089:0:5881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5879:x1875463014268416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788581200.192625:0:5881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5879:x1875463014268416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 534us (1074us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788581200.192634:0:5881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581200.192717:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076315880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5879:1875463014268416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788581200.192867:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788581200.192915:0:5879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70dbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581200.192926:0:5879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70dbc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581200.192933:0:5879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70dbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581200.192952:0:5879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581200.192957:0:5879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70dbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581200.192965:0:5879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70dbc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581200.192982:0:5879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341000) 00010000:00010000:1.0:1788581200.192985:0:5879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788581200.192990:0:5879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70dbc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581200.192996:0:5879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a70dbc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5879 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788581200.193298:0:5879:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788581200.193433:0:5879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788581200.193445:0:5879:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 416434201566ns, next at 417434199119ns, rc = 0 00000001:00080000:1.0:1788581200.193452:0:5879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788581200.193489:0:5879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341000) 00010000:00010000:1.0:1788581200.193492:0:5879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788581200.193499:0:5879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70da7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d932f expref: 51 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581200.193603:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190673cdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+50:11600:x1875462995401472:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 19531us (19757us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788581200.193612:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 56 00000020:00080000:1.0:1788581200.193616:0:5879:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788581200.196722:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581200.196888:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995401728 00000100:00100000:3.0:1788581200.196898:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995401728 00000100:00100000:3.0:1788581200.196960:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 203 00000100:00100000:3.0:1788581200.196984:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+50:11600:x1875462995401728:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581200.197009:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581200.197033:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70dc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9336 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.197095:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70dc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9336 expref: 51 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.197110:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70dc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9336 expref: 51 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.197131:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:3.0:1788581200.197134:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581200.197138:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf800, rc 0) 00000100:00100000:3.0:1788581200.197221:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+51:11600:x1875462995401728:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 238us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581200.197228:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 203 00000100:00100000:2.0:1788581200.201569:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581200.201772:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995401984 00000100:00100000:3.0:1788581200.201782:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995401984 00000100:00100000:3.0:1788581200.201839:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 57 00000100:00100000:3.0:1788581200.201849:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+51:11600:x1875462995401984:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:3.0:1788581200.202087:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:11600:x1875462995401984:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 238us (528us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788581200.202096:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 57 00000100:00100000:2.0:1788581200.343039:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581200.343410:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995402112 00000100:00100000:0.0:1788581200.343420:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995402112 00000100:00100000:0.0:1788581200.343494:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 204 00000100:00100000:0.0:1788581200.343505:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:11610:x1875462995402112:12345-192.168.201.13@tcp:34:lfs.0 00010000:00010000:0.0:1788581200.343586:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70dca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343605:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70dca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343617:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70dca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343634:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70dd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343641:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343648:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343758:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70dd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343768:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343774:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581200.343816:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343845:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70dca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343853:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70dca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343861:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70dca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343867:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581200.343871:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70dca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343879:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70dca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343891:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:0.0:1788581200.343894:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581200.343899:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70dca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343906:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70dca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343918:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343924:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70dd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343929:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343941:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581200.343945:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343951:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70dd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343958:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91904995a200) 00010000:00010000:0.0:1788581200.343961:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581200.343963:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70dd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343969:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70dd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343983:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343990:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70dd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.343996:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.344002:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581200.344005:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.344011:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70dd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.344027:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:0.0:1788581200.344029:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581200.344032:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70dd8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.344039:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70dd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581200.344115:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:11610:x1875462995402112:12345-192.168.201.13@tcp:34:lfs.0 Request processed in 611us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581200.344124:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 204 00000100:00100000:0.0:1788581200.394350:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581200.394442:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995402368 00000100:00100000:3.0:1788581200.394453:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995402368 00000100:00100000:3.0:1788581200.394514:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 205 00000100:00100000:3.0:1788581200.394538:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+52:11613:x1875462995402368:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581200.394559:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581200.394580:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70ddf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d933d expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.394661:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70de6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.394677:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.394689:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.394706:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70ded lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.394714:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.394721:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.394858:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70df4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.394868:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.394875:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581200.394897:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788581200.394989:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.394997:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70de6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.395005:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70de6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.395012:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cfa00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581200.395017:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70de6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.395025:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70de6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.395037:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:3.0:1788581200.395040:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581200.395044:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70de6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.395051:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70de6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.395063:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.395069:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70ded lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.395086:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.395091:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581200.395095:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.395101:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70ded lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.395110:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919052341f00) 00010000:00010000:3.0:1788581200.395112:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581200.395115:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70ded lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.395121:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70ded lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.395159:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70ddf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d933d expref: 55 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.395174:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70df4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d933d expref: 54 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.395183:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:3.0:1788581200.395185:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581200.395187:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf000, rc 0) 00000100:00100000:3.0:1788581200.395304:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:11613:x1875462995402368:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 767us (963us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788581200.395320:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 205 00000100:00100000:2.0:1788581200.399527:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581200.399609:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995402496 00000100:00100000:0.0:1788581200.399619:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995402496 00000100:00100000:0.0:1788581200.399679:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 206 00000100:00100000:0.0:1788581200.399690:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:11613:x1875462995402496:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:0.0:1788581200.399794:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70e02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.399809:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70e02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.399820:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70e02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.399846:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70e02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.399851:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70e02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.399870:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70e02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.399876:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581200.399879:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70e02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.399887:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70e02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.399899:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:0.0:1788581200.399902:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581200.399912:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70e02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.399918:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70e02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581200.399991:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:11613:x1875462995402496:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 303us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581200.399996:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 206 00000100:00100000:2.0:1788581200.401870:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581200.401933:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995402752 00000100:00100000:3.0:1788581200.401941:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995402752 00000100:00100000:3.0:1788581200.401981:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 58 00000100:00100000:3.0:1788581200.401988:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+54:11613:x1875462995402752:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:3.0:1788581200.402190:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:11613:x1875462995402752:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 202us (326us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788581200.402197:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 58 00000100:00100000:1.0:1788581200.494570:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581200.494678:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995403008 00000100:00100000:3.0:1788581200.494689:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995403008 00000100:00100000:3.0:1788581200.494766:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 207 00000100:00100000:3.0:1788581200.494778:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ca95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:11623:x1875462995403008:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1788581200.494801:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581200.494804:0:9658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788581200.494831:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70d84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9321 expref: 55 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.494851:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:3.0:1788581200.494855:0:9658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581200.494870:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70e09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9344 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.494976:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e10 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.494991:0:9658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70df4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d933d expref: 55 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.495015:0:9658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e10 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.495049:0:9658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70df4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d933d expref: 55 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.495062:0:9658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70df4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d933d expref: 55 pid: 9658 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581200.495076:0:9658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f715880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9658:1875463014268544:192.168.201.13@tcp:104: 00000100:00100000:3.0:1788581200.495183:0:9658:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f4118cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581200.496447:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c96ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3339:1875463014268800:0@lo:400:kworker.0 00000100:00100000:2.0:1788581200.496499:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581200.496536:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788581200.496543:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c96f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014268672:0@lo:400:kworker.0 00000100:00100000:2.0:1788581200.496569:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581200.496606:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c96d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3339:1875463014269184:0@lo:400:kworker.0 00000100:00100000:2.0:1788581200.496629:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581200.497140:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c96fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014268928:0@lo:400:kworker.0 00000100:00100000:1.0:1788581200.497174:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581200.497216:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581200.497224:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c96ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014269056:0@lo:400:kworker.0 00000100:00100000:1.0:1788581200.497274:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581200.497308:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014269056 00000100:00100000:1.0:1788581200.497315:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014269056 00000100:00100000:1.0:1788581200.497365:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788581200.497374:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f4370a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3340:x1875463014269056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581200.497422:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f4370a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3340:x1875463014269056:12345-0@lo:400:kworker.0 Request processed in 49us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581200.497430:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1788581200.497452:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581200.497493:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c96ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014269056:0@lo:400:kworker.0 00000100:00100000:2.0:1788581200.497737:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014268800 00000100:00100000:2.0:1788581200.497742:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014268800 00000100:00100000:2.0:1788581200.497761:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014269184 00000100:00100000:2.0:1788581200.497764:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014269184 00000100:00100000:2.0:1788581200.497780:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014268928 00000100:00100000:2.0:1788581200.497782:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014268928 00000100:00100000:2.0:1788581200.497798:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788581200.497805:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3339:x1875463014268800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581200.497831:0:5876:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788581200.497843:0:5876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788581200.497851:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3339:x1875463014268800:12345-0@lo:400:kworker.0 Request processed in 46us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581200.497859:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788581200.497873:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788581200.497879:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3339:x1875463014269184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581200.497913:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3339:x1875463014269184:12345-0@lo:400:kworker.0 Request processed in 35us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581200.497920:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788581200.497935:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788581200.497954:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f4370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014268928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581200.497989:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f4370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014268928:12345-0@lo:400:kworker.0 Request processed in 36us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581200.497995:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788581200.498027:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c96d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3339:1875463014269184:0@lo:400:kworker.0 00000100:00100000:2.0:1788581200.498041:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c96ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3339:1875463014268800:0@lo:400:kworker.0 00000100:00100000:0.0:1788581200.498129:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014268672 00000100:00100000:0.0:1788581200.498134:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014268672 00000100:00100000:0.0:1788581200.498175:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788581200.498184:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3339:x1875463014268672:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788581200.498841:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581200.498876:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c96fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014268928:0@lo:400:kworker.0 00000100:00100000:1.0:1788581200.504324:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581200.504365:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995403136 00000100:00100000:1.0:1788581200.504373:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995403136 00010000:00010000:1.0:1788581200.504412:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70df4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d933d expref: 56 pid: 9658 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581200.504464:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 78 00000100:00100000:1.0:1788581200.504473:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43708380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+56:2374:x1875462995403136:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581200.504487:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581200.504507:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70df4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d933d expref: 56 pid: 9658 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581200.504520:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70df4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d933d expref: 56 pid: 9658 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581200.504543:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:1.0:1788581200.504547:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e10 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581200.504556:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581200.504563:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e10 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581200.504581:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581200.504631:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43708380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+56:2374:x1875462995403136:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 158us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581200.504638:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 78 00000100:00100000:0.0:1788581200.505223:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3339:x1875463014268672:12345-0@lo:400:kworker.0 Request processed in 7038us (8649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581200.505233:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788581200.505317:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c96f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014268672:0@lo:400:kworker.0 00010000:00010000:3.0:1788581200.511372:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70df4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d933d expref: 55 pid: 9658 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581200.511395:0:9658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f715880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9658:1875463014268544:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581200.511420:0:9658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.511430:0:9658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.511436:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581200.511459:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788581200.511610:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70e09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9344 expref: 56 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.511642:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9344 expref: 55 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.511651:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:3.0:1788581200.511654:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788581200.511657:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf400, rc 0) 00000100:00100000:3.0:1788581200.511752:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ca95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:11623:x1875462995403008:12345-192.168.201.13@tcp:101:bash.0 Request processed in 16968us (17183us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788581200.511761:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 207 00000100:00100000:1.0:1788581200.518174:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581200.518284:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995403392 00000100:00100000:2.0:1788581200.518296:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995403392 00000100:00100000:2.0:1788581200.518346:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 208 00000100:00100000:2.0:1788581200.518355:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+55:11623:x1875462995403392:12345-192.168.201.13@tcp:36:bash.0 00010000:00010000:2.0:1788581200.518615:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62c00/0xf54e3944c2a70e1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581200.518631:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62c00/0xf54e3944c2a70e1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581200.518643:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62c00/0xf54e3944c2a70e1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581200.518690:0:5878:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788581200.518711:0:5878:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be1a557f reply state 00000000325a8f26 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62c00/0xf54e3944c2a70e1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581200.518720:0:5878:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788581200.518811:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:11623:x1875462995403392:12345-192.168.201.13@tcp:36:bash.0 Request processed in 457us (646us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788581200.518819:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 208 00000020:00080000:2.0:1788581200.518823:0:5878:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788581200.524670:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00010000:00010000:3.0:1788581200.524809:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62c00/0xf54e3944c2a70e1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.524823:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62c00/0xf54e3944c2a70e1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.524830:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62c00/0xf54e3944c2a70e1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.524836:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb62c00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581200.524841:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62c00/0xf54e3944c2a70e1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.524849:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62c00/0xf54e3944c2a70e1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.524867:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:3.0:1788581200.524870:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581200.524875:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62c00/0xf54e3944c2a70e1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.524896:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62c00/0xf54e3944c2a70e1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581200.524972:0:12524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995403520 00000100:00100000:0.0:1788581200.524983:0:12524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995403520 00000100:00100000:0.0:1788581200.525036:0:12524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 209 00000100:00100000:0.0:1788581200.525045:0:12524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:11623:x1875462995403520:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:0.0:1788581200.525068:0:12524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581200.525084:0:12524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70e25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d934b expref: -99 pid: 12524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.525179:0:12524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70e2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.525191:0:12524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e10 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9344 expref: 58 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.525200:0:12524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70e2c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.525235:0:12524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9344 expref: 58 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.525291:0:12524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e10 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9344 expref: 58 pid: 9658 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581200.525306:0:12524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c96f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12524:1875463014269312:192.168.201.13@tcp:104: 00000100:00100000:0.0:1788581200.525378:0:12524:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f4357ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581200.531101:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581200.531185:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995403648 00000100:00100000:3.0:1788581200.531203:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995403648 00000100:00100000:0.0:1788581200.531216:0:12524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c96f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12524:1875463014269312:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581200.531241:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e10 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9344 expref: 59 pid: 9658 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.531264:0:12524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70e2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581200.531307:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 79 00000100:00100000:3.0:1788581200.531318:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:2375:x1875462995403648:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581200.531332:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581200.531339:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e10 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9344 expref: 59 pid: 9658 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.531363:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9344 expref: 59 pid: 9658 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.531387:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9344 expref: 59 pid: 9658 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.531401:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:3.0:1788581200.531405:0:5863:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70e2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.531415:0:5863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.531422:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70e2c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.531458:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581200.531515:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:2375:x1875462995403648:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 198us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581200.531523:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 79 00010000:00010000:0.0:1788581200.532612:0:12524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.532624:0:12524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581200.532670:0:12524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788581200.532675:0:12524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788581200.532697:0:12524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.532741:0:12524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70e25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d934b expref: 58 pid: 12524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.532758:0:12524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d934b expref: 57 pid: 12524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.532767:0:12524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:0.0:1788581200.532770:0:12524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581200.532773:0:12524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc23800, rc 0) 00000100:00100000:0.0:1788581200.532825:0:12524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:11623:x1875462995403520:12345-192.168.201.13@tcp:101:bash.0 Request processed in 7779us (8167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581200.532833:0:12524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 209 00000100:00100000:1.0:1788581200.539351:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581200.539434:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995403904 00000100:00100000:3.0:1788581200.539446:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995403904 00000100:00100000:3.0:1788581200.539508:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 59 00000100:00100000:3.0:1788581200.539519:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+57:11623:x1875462995403904:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:3.0:1788581200.539783:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:11623:x1875462995403904:12345-192.168.201.13@tcp:35:bash.0 Request processed in 265us (440us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788581200.539791:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 59 00000100:00100000:1.0:1788581200.658732:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581200.658814:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995404032 00000100:00100000:3.0:1788581200.658825:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995404032 00000100:00100000:3.0:1788581200.658897:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 210 00000100:00100000:3.0:1788581200.658908:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+58:11629:x1875462995404032:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581200.658933:0:9658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581200.658955:0:9658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9352 expref: -99 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.659025:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70e3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.659039:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.659050:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581200.659102:0:9658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788581200.659106:0:9658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581200.659429:0:9658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.659466:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9352 expref: 60 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.659485:0:9658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70e3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9352 expref: 59 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.659493:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:3.0:1788581200.659496:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581200.659499:0:9658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce000, rc 0) 00000100:00100000:3.0:1788581200.659612:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:11629:x1875462995404032:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 705us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581200.659619:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 210 00000100:00100000:1.0:1788581200.663653:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581200.663744:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995404160 00000100:00100000:3.0:1788581200.663755:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995404160 00000100:00100000:3.0:1788581200.663814:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 211 00000100:00100000:3.0:1788581200.663825:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c60f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:11629:x1875462995404160:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581200.663853:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581200.663878:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70e41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9359 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.663968:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.663993:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664005:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664023:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664029:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664036:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664147:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70e56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664157:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664164:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581200.664556:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788581200.664562:0:5876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581200.664586:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664599:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664620:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664626:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664634:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664640:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cfa00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581200.664644:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664652:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664665:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:3.0:1788581200.664668:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581200.664673:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664679:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664693:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664699:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664704:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664717:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cee00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581200.664731:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664738:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664747:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919052341f00) 00010000:00010000:3.0:1788581200.664749:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581200.664753:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664759:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664793:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70e41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9359 expref: 61 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664806:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70e56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9359 expref: 60 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.664812:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:3.0:1788581200.664815:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581200.664818:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce600, rc 0) 00000100:00100000:3.0:1788581200.664900:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c60f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+60:11629:x1875462995404160:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1076us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581200.664908:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 211 00000100:00100000:1.0:1788581200.674885:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581200.674945:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581200.675079:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995404288 00000100:00100000:2.0:1788581200.675091:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995404288 00000100:00100000:2.0:1788581200.675180:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:2.0:1788581200.675190:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+60:2374:x1875462995404288:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581200.675205:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581200.675231:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce600/0xf54e3944c2a70e56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9359 expref: 60 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581200.675287:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:2.0:1788581200.675293:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581200.675341:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:2374:x1875462995404288:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 152us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581200.675348:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:0.0:1788581200.676087:0:12524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995404544 00000100:00100000:0.0:1788581200.676094:0:12524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995404544 00000100:00100000:0.0:1788581200.676274:0:12524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 212 00000100:00100000:0.0:1788581200.676284:0:12524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:11629:x1875462995404544:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1788581200.676301:0:12524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581200.676332:0:12524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70e5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9360 expref: -99 pid: 12524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.676433:0:12524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70e64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.676446:0:12524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70e2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d934b expref: 60 pid: 12524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.676455:0:12524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70e64 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.676486:0:12524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d934b expref: 60 pid: 12524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.676498:0:12524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70e2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d934b expref: 60 pid: 12524 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581200.676511:0:12524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c96f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12524:1875463014269440:192.168.201.13@tcp:104: 00000100:00100000:0.0:1788581200.676610:0:12524:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f4357ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581200.692968:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581200.693074:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995404672 00000100:00100000:3.0:1788581200.693100:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995404672 00010000:00010000:3.0:1788581200.693153:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70e2c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d934b expref: 61 pid: 12524 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581200.693197:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 80 00000100:00100000:3.0:1788581200.693215:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+61:2374:x1875462995404672:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581200.693230:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581200.693236:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70e2c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d934b expref: 61 pid: 12524 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.693290:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70e2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d934b expref: 61 pid: 12524 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.693312:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:3.0:1788581200.693317:0:5863:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70e64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.693327:0:5863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70e64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.693335:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70e64 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.693354:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581200.693403:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+61:2374:x1875462995404672:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 197us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581200.693411:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 80 00010000:00010000:0.0:1788581200.693646:0:12524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70e2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d934b expref: 60 pid: 12524 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581200.693662:0:12524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c96f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12524:1875463014269440:192.168.201.13@tcp:104: 00010000:00010000:0.0:1788581200.693689:0:12524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70e64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.693697:0:12524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70e64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.693715:0:12524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70e64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581200.693746:0:12524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788581200.693889:0:12524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70e5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9360 expref: 61 pid: 12524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.693903:0:12524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70e64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9360 expref: 60 pid: 12524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581200.693912:0:12524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:0.0:1788581200.693915:0:12524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788581200.693917:0:12524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc23600, rc 0) 00000100:00100000:0.0:1788581200.693947:0:12524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11f1870a-1d9b-4af2-bb25-e81f8742df75+60:11629:x1875462995404544:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 17666us (19001us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788581200.693954:0:12524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 212 00000100:00100000:1.0:1788581200.707795:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581200.707954:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995404928 00000100:00100000:3.0:1788581200.707965:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995404928 00000100:00100000:3.0:1788581200.708045:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:3.0:1788581200.708056:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049af3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+60:11629:x1875462995404928:12345-192.168.201.13@tcp:103:lfs.0 00010000:00010000:3.0:1788581200.708074:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581200.708100:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70dc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9336 expref: 60 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.708118:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:3.0:1788581200.708123:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581200.708189:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049af3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:11629:x1875462995404928:12345-192.168.201.13@tcp:103:lfs.0 Request processed in 134us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581200.708196:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:1.0:1788581200.725897:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581200.726024:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995405056 00000100:00100000:3.0:1788581200.726035:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995405056 00000100:00100000:3.0:1788581200.726102:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 213 00000100:00100000:3.0:1788581200.726114:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:11629:x1875462995405056:12345-192.168.201.13@tcp:58:lfs.0 00010000:00010000:3.0:1788581200.726233:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70e72 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.726280:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70e72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.726293:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70e72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788581200.726496:0:9658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788581200.726592:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:11629:x1875462995405056:12345-192.168.201.13@tcp:58:lfs.0 Request processed in 479us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581200.726600:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 213 00000100:00100000:1.0:1788581200.731873:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581200.732065:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995405184 00000100:00100000:3.0:1788581200.732076:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995405184 00000100:00100000:3.0:1788581200.732151:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 214 00000100:00100000:3.0:1788581200.732162:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+59:11629:x1875462995405184:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581200.732195:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581200.732224:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70e79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9367 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.732320:0:5876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70e72 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.732333:0:5876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70e79 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9367 expref: 60 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.732352:0:5876:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70e72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.732365:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70e79 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9367 expref: 60 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.732380:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:3.0:1788581200.732383:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581200.732387:0:5876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70e79 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9367 expref: 60 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581200.732394:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf000, rc 0) 00000100:00100000:3.0:1788581200.732461:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+60:11629:x1875462995405184:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 300us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581200.732468:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 214 00000100:00100000:1.0:1788581200.772229:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581200.772302:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581200.772337:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581200.772389:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581200.772429:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995405440 00000100:00100000:1.0:1788581200.772438:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995405440 00000100:00100000:1.0:1788581200.772485:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995405568 00000100:00100000:1.0:1788581200.772488:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995405568 00000100:00100000:1.0:1788581200.772512:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 97 00000100:00100000:1.0:1788581200.772521:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:2372:x1875462995405440:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581200.772587:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:2372:x1875462995405440:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 68us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581200.772595:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 97 00000100:00100000:1.0:1788581200.772611:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 98 00000100:00100000:1.0:1788581200.772616:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2372:x1875462995405568:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581200.772635:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2372:x1875462995405568:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 19us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581200.772641:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 98 00000100:00100000:0.0:1788581200.772899:0:12524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995405696 00000100:00100000:0.0:1788581200.772905:0:12524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995405696 00000100:00100000:2.0:1788581200.772930:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995405312 00000100:00100000:2.0:1788581200.772937:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995405312 00000100:00100000:0.0:1788581200.772964:0:12524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 168 00000100:00100000:0.0:1788581200.772974:0:12524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2372:x1875462995405696:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581200.772980:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 303 00000100:00100000:2.0:1788581200.772991:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2372:x1875462995405312:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581200.773021:0:12524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2372:x1875462995405696:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 48us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581200.773029:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2372:x1875462995405312:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 39us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581200.773032:0:12524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 168 00000100:00100000:2.0:1788581200.773042:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 303 00000100:00080000:1.0:1788581200.773872:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788581200.943438:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581201.008191:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581201.008224:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014269568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581201.008319:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581201.008490:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014269568 00000100:00100000:1.0:1788581201.008499:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014269568 00000100:00100000:1.0:1788581201.008552:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788581201.008562:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3338:x1875463014269568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581201.008584:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581201.008634:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3338:x1875463014269568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581201.008654:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788581201.009515:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014269568:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788581201.391920:0:11735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788581201.391930:0:11735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788581201.391966:0:11735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788581201.391972:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788581201.392099:0:11735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f716680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11735:1875463014269696:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788581201.392207:0:11735:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f4118cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581201.396112:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581201.396287:0:11735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f716680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11735:1875463014269696:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788581201.396889:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995405824 00000100:00100000:2.0:1788581201.396898:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995405824 00000100:00100000:2.0:1788581201.396972:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 215 00000100:00100000:2.0:1788581201.396982:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+60:11630:x1875462995405824:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788581201.397025:0:9658:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788581201.397122:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+60:11630:x1875462995405824:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 141us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581201.397129:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 215 00000100:00080000:1.0:1788581201.397907:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581201.414584:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581201.414647:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995405952 00000100:00100000:3.0:1788581201.414658:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995405952 00000100:00100000:3.0:1788581201.414738:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 216 00000100:00100000:3.0:1788581201.414749:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+60:11630:x1875462995405952:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788581201.414828:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e80 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.414846:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e80 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.414860:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e80 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.414877:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e87 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.414885:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.414912:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.414936:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.414944:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.414951:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581201.414990:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788581201.414994:0:5876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581201.415008:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415020:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e80 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415026:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e80 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415032:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e80 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415038:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cee00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581201.415042:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e80 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415049:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e80 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415068:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91904995af00) 00010000:00010000:3.0:1788581201.415071:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581201.415075:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e80 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415081:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cee00/0xf54e3944c2a70e80 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415096:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e87 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415102:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e87 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415107:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e87 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415112:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cfa00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581201.415115:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e87 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415133:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e87 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415142:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff919052341f00) 00010000:00010000:3.0:1788581201.415144:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581201.415147:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e87 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415153:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70e87 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415178:0:5876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415184:0:5876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415189:0:5876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415195:0:5876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581201.415199:0:5876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415205:0:5876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415212:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:3.0:1788581201.415215:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581201.415218:0:5876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.415223:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70e8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581201.415334:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+60:11630:x1875462995405952:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 Request processed in 585us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581201.415343:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 216 00000100:00100000:0.0:1788581201.418695:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581201.418869:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995406208 00000100:00100000:2.0:1788581201.418964:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995406208 00000100:00100000:2.0:1788581201.419064:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 217 00000100:00100000:2.0:1788581201.419077:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+60:11630:x1875462995406208:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581201.419100:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581201.419123:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70e95 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d936e expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.419223:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70e9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.419239:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.419284:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581201.419297:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788581201.421557:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.421572:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70e9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.421578:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70e9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.421599:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb62400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581201.421604:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70e9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.421611:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70e9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.421627:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:2.0:1788581201.421630:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788581201.421634:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70e9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.421640:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70e9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.421697:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70e95 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d936e expref: 62 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.421717:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91904995af00) 00010000:00010000:2.0:1788581201.421719:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788581201.421724:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70e95 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d936e expref: 62 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.421733:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91906cb62600, rc 0) 00000100:00100000:2.0:1788581201.421813:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+61:11630:x1875462995406208:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 2738us (3128us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788581201.421822:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 217 00000100:00100000:1.0:1788581201.435840:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581201.436084:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995406336 00000100:00100000:3.0:1788581201.436095:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995406336 00000100:00100000:3.0:1788581201.436159:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 218 00000100:00100000:3.0:1788581201.436184:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+61:11630:x1875462995406336:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788581201.436221:0:5878:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788581201.436355:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+61:11630:x1875462995406336:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 172us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581201.436363:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 218 00000100:00100000:1.0:1788581201.444409:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581201.447000:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995406592 00000100:00100000:3.0:1788581201.447018:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995406592 00000100:00100000:3.0:1788581201.447205:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 219 00000100:00100000:3.0:1788581201.447217:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+61:11630:x1875462995406592:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581201.447240:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581201.447284:0:5876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788581201.447313:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a70e3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9352 expref: 61 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.447332:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:3.0:1788581201.447337:0:5876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581201.447351:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70eaa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9375 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788581201.449777:0:5876:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1788581201.450034:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70eb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.450049:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.450061:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.450450:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70eaa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9375 expref: 63 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.450472:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9375 expref: 62 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.450481:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff919052341f00) 00010000:00010000:3.0:1788581201.450484:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581201.450487:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cfa00, rc 0) 00000100:00100000:3.0:1788581201.450567:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+62:11630:x1875462995406592:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 3351us (6168us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788581201.450576:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 219 00000100:00100000:1.0:1788581201.464680:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581201.465048:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995406848 00000100:00100000:2.0:1788581201.465073:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995406848 00000100:00100000:2.0:1788581201.465147:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 220 00000100:00100000:2.0:1788581201.465159:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+62:11630:x1875462995406848:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788581201.465222:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581201.465282:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cfa00/0xf54e3944c2a70eb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9375 expref: 62 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465301:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff919052341f00) 00010000:00010000:2.0:1788581201.465312:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788581201.465335:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ebf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465349:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ebf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465359:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ebf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465383:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70ec6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf4c3245e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465391:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf4c3245e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465398:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf4c3245e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465484:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ebf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465493:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ebf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465505:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ebf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465511:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb62600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581201.465515:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ebf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465523:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ebf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465532:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:2.0:1788581201.465535:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581201.465538:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ebf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465542:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ebf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465551:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf4c3245e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465556:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70ec6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf4c3245e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465561:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70ec6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf4c3245e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465565:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb62400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581201.465567:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70ec6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf4c3245e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465585:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70ec6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf4c3245e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465593:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf4c3245e (ffff91905c525e00) 00010000:00010000:2.0:1788581201.465595:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581201.465598:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70ec6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf4c3245e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.465603:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62400/0xf54e3944c2a70ec6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf4c3245e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581201.465688:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+61:11630:x1875462995406848:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 530us (1016us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581201.465696:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 220 00000100:00100000:2.0:1788581201.472873:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581201.472985:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995406976 00000100:00100000:3.0:1788581201.473009:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995406976 00000100:00100000:0.0:1788581201.473152:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 221 00000100:00100000:0.0:1788581201.473163:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+61:11630:x1875462995406976:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581201.473216:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581201.473285:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70ecd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d937c expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.473333:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70ed4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.473346:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.473356:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.473487:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70ecd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d937c expref: 63 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.473505:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d937c expref: 62 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.473513:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91904995a200) 00010000:00010000:0.0:1788581201.473515:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788581201.473518:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc23a00, rc 0) 00000100:00100000:0.0:1788581201.473592:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+62:11630:x1875462995406976:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 431us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581201.473599:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 221 00000100:00100000:0.0:1788581201.483704:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581201.483911:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995407232 00000100:00100000:3.0:1788581201.483922:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995407232 00000100:00100000:3.0:1788581201.483986:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 222 00000100:00100000:3.0:1788581201.483998:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+62:11630:x1875462995407232:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788581201.484092:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70edb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.484110:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70edb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.484130:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70edb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788581201.484422:0:5876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1788581201.484443:0:5876:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 417725198759ns, next at 418725196939ns, rc = 0 00000004:00010000:3.0:1788581201.484526:0:5876:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093a8ee82 reply state 0000000004514343 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70edb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581201.484533:0:5876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788581201.484732:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+64:11630:x1875462995407232:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 733us (1036us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788581201.484739:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 222 00010000:00010000:2.0:1788581201.490805:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70edb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.490821:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70edb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.490828:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70edb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.490833:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581201.490837:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70edb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.490845:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70edb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.490900:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91904995a200) 00010000:00010000:2.0:1788581201.490903:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788581201.490907:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70edb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.490914:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a70edb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581201.493634:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581201.493815:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995407360 00000100:00100000:2.0:1788581201.493825:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995407360 00000100:00100000:2.0:1788581201.493888:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 223 00000100:00100000:2.0:1788581201.493899:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+63:11630:x1875462995407360:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581201.493923:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581201.493944:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ee2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9383 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.494009:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9383 expref: 64 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.494025:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9383 expref: 64 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.494046:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91904995a200) 00010000:00010000:2.0:1788581201.494049:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788581201.494052:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91906cb62600, rc 0) 00000100:00100000:2.0:1788581201.494114:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+64:11630:x1875462995407360:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 216us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581201.494565:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 223 00000100:00100000:3.0:1788581201.497041:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581201.497280:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995407488 00000100:00100000:1.0:1788581201.497290:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995407488 00000100:00100000:1.0:1788581201.497420:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 62 00000100:00100000:1.0:1788581201.497432:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:2374:x1875462995407488:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788581201.497779:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+10:2374:x1875462995407488:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 348us (746us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788581201.497787:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 62 00000100:00080000:2.0:1788581201.498545:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581201.501111:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581201.501208:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995407744 00000100:00100000:2.0:1788581201.501220:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995407744 00000100:00100000:2.0:1788581201.501303:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 60 00000100:00100000:2.0:1788581201.501313:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+64:11630:x1875462995407744:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788581201.502040:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+65:11630:x1875462995407744:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 724us (938us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788581201.502050:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 60 00000100:00100000:0.0:1788581201.504298:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581201.504963:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995408000 00000100:00100000:2.0:1788581201.504975:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995408000 00000100:00100000:2.0:1788581201.505041:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 224 00000100:00100000:2.0:1788581201.505051:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+65:11630:x1875462995408000:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788581201.505402:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+65:11630:x1875462995408000:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 351us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581201.505410:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 224 00000100:00100000:3.0:1788581201.512905:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581201.513282:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995408128 00000100:00100000:0.0:1788581201.513292:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995408128 00000100:00100000:0.0:1788581201.513356:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 225 00000100:00100000:0.0:1788581201.513377:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+65:11630:x1875462995408128:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581201.513399:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581201.513423:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70ee9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d938a expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.513500:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70ef0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.513514:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.513526:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581201.513564:0:5876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788581201.513584:0:5876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.513612:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70ee9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d938a expref: 67 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.513631:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d938a expref: 66 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.513640:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91904995a200) 00010000:00010000:0.0:1788581201.513643:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788581201.513646:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc23800, rc 0) 00000100:00100000:0.0:1788581201.513729:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+66:11630:x1875462995408128:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 363us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581201.513736:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 225 00000100:00100000:1.0:1788581201.521952:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581201.521989:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995408256 00000100:00100000:1.0:1788581201.522001:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995408256 00000100:00100000:1.0:1788581201.522061:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 63 00000100:00100000:1.0:1788581201.522072:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+10:2375:x1875462995408256:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581201.522092:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581201.522112:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000753f6578/0xf54e3944c2a70ef7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9391 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788581201.522156:0:6725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b9551, blocks: 0x1 00010000:00010000:1.0:1788581201.522179:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788581201.522192:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581201.522203:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000753f6578/0xf54e3944c2a70ef7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9391 expref: 11 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.522224:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000753f6578/0xf54e3944c2a70ef7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9391 expref: 11 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.522238:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8600, rc 0) 00000100:00100000:1.0:1788581201.522316:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+11:2375:x1875462995408256:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 245us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581201.535135:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 63 00000100:00100000:1.0:1788581201.539440:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581201.539531:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995408512 00000100:00100000:3.0:1788581201.539542:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995408512 00000100:00100000:3.0:1788581201.539603:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 226 00000100:00100000:3.0:1788581201.539612:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+66:11630:x1875462995408512:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788581201.539742:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+66:11630:x1875462995408512:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 129us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581201.539749:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 226 00000100:00100000:2.0:1788581201.545205:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581201.545276:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995408640 00000100:00100000:2.0:1788581201.545287:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995408640 00000100:00100000:2.0:1788581201.545338:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 64 00000100:00100000:2.0:1788581201.545348:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+11:11630:x1875462995408640:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581201.545367:0:6722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581201.545399:0:6722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5de672d/0xf54e3944c2a70efe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9398 expref: -99 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.545446:0:6722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000753f6578/0xf54e3944c2a70ef7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9391 expref: 12 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.545456:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581201.545461:0:6722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581201.545467:0:6722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5de672d/0xf54e3944c2a70efe lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9398 expref: 12 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.545501:0:6722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000753f6578/0xf54e3944c2a70ef7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9391 expref: 12 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.545516:0:6722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000753f6578/0xf54e3944c2a70ef7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9391 expref: 12 pid: 6725 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581201.545532:0:6722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f411ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6722:1875463014269824:192.168.201.13@tcp:104: 00000100:00100000:2.0:1788581201.545617:0:6722:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f43587a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581201.564425:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581201.564460:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995408768 00000100:00100000:2.0:1788581201.564469:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995408768 00010000:00010000:2.0:1788581201.564511:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000753f6578/0xf54e3944c2a70ef7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9391 expref: 13 pid: 6725 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581201.564566:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 81 00000100:00100000:2.0:1788581201.564577:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:2375:x1875462995408768:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581201.564611:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581201.564647:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000753f6578/0xf54e3944c2a70ef7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9391 expref: 13 pid: 6725 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.564662:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000753f6578/0xf54e3944c2a70ef7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9391 expref: 13 pid: 6725 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.564688:0:5863:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581201.564693:0:5863:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581201.564702:0:5863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5de672d/0xf54e3944c2a70efe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9398 expref: 13 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.564723:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5de672d/0xf54e3944c2a70efe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9398 expref: 13 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.564761:0:5863:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a5de672d/0xf54e3944c2a70efe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9398 expref: 13 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581201.564777:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f411edf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5863:1875463014269952:192.168.201.13@tcp:105: 00010000:00010000:3.0:1788581201.564838:0:6722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000753f6578/0xf54e3944c2a70ef7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9391 expref: 13 pid: 6725 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581201.564859:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907b909900 going to sleep for 11 seconds 00000100:00100000:3.0:1788581201.564860:0:6722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f411ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6722:1875463014269824:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581201.567132:0:6722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5de672d/0xf54e3944c2a70efe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9398 expref: 12 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.567155:0:6722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91906cb62a00, rc 0) 00000100:00100000:3.0:1788581201.567237:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+12:11630:x1875462995408640:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 21889us (22042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581201.567280:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 64 00000100:00100000:2.0:1788581201.581016:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581201.581049:0:6730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995408896 00000100:00100000:2.0:1788581201.581058:0:6730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995408896 00002000:00100000:2.0:1788581201.581113:0:6730:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff918f411ed880 x1875462995408896/t0(0) o4->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:557/0 lens 504/0 e 0 to 0 dl 1788581212 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788581201.581126:0:6730:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918f411ed880 with x1875462995408896 ext(0->12) 00002000:00010000:2.0:1788581201.581144:0:6730:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918f411ed880 00000100:00100000:2.0:1788581201.581170:0:6730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:2.0:1788581201.581179:0:6730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+12:2375:x1875462995408896:12345-192.168.201.13@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788581201.581653:0:6730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+14:2375:x1875462995408896:12345-192.168.201.13@tcp:4:lhsmtool_posix.0 Request processed in 473us (647us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788581201.581662:0:6730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 6 00002000:00100000:2.0:1788581201.581669:0:6730:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff918f411ed880 x1875462995408896/t4294967320(0) o4->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:557/0 lens 504/448 e 0 to 0 dl 1788581212 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788581201.581676:0:6730:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918f411ed880 with x1875462995408896 ext(0->12) 00002000:00010000:2.0:1788581201.581680:0:6730:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918f411ed880 00000100:00100000:1.0:1788581201.581886:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f411edf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5863:1875463014269952:192.168.201.13@tcp:105: 00010000:00010000:1.0:1788581201.581912:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581201.581940:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:2375:x1875462995408768:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 17365us (17525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581201.581948:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 81 00000100:00100000:2.0:1788581201.592346:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581201.592756:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995409024 00000100:00100000:3.0:1788581201.592766:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995409024 00000100:00100000:3.0:1788581201.592818:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 227 00000100:00100000:3.0:1788581201.592828:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+66:11630:x1875462995409024:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788581201.630147:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1788581201.630170:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1788581201.630176:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1788581201.693857:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000004:00080000:1.0:1788581201.693883:0:5899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788581201.693909:0:5899:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9190485c7d80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788581201.693913:0:5899:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91907fbf6400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9190485c7300 00000020:00080000:1.0:1788581201.693916:0:5899:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91907fbf6100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91906c6fd400 00000001:00080000:1.0:1788581201.693937:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1788581201.693950:0:5899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788581201.693987:0:5899:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff918f43587000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788581201.693991:0:5899:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9190768dce00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff918f435879c0 00000020:00080000:1.0:1788581201.694008:0:5899:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9190768dcf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91907bb85000 00000004:00080000:1.0:1788581201.694025:0:5899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:1.0:1788581201.694055:0:5899:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:1.0:1788581201.694217:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014270080:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788581201.694499:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581201.694565:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581201.694571:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014270208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788581201.694594:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581201.694627:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014270080 00000100:00100000:1.0:1788581201.694636:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014270080 00000100:00100000:1.0:1788581201.694678:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014270208 00000100:00100000:1.0:1788581201.694681:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014270208 00000100:00100000:1.0:1788581201.694699:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788581201.694718:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3340:x1875463014270080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788581201.694742:0:6725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1788581201.694766:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b84d77e7/0xf54e3944c2a70f05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.694787:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a70cc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92f7 expref: 12 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.694797:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788581201.694801:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788581201.694806:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b84d77e7/0xf54e3944c2a70f05 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.694833:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a70cc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92f7 expref: 12 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.694854:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a70cc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92f7 expref: 12 pid: 6725 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581201.694867:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6725:1875463014270336:192.168.201.13@tcp:104: 00000100:00100000:1.0:1788581201.694923:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190411ca000 going to sleep for 11 seconds 00000100:00100000:1.0:1788581201.694938:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788581201.694946:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3340:x1875463014270208:12345-0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1788581201.695156:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788581201.695482:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788581201.695515:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014270464:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788581201.695551:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581201.695585:0:6723:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788581201.695592:0:6723:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788581201.695689:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014270464 00000100:00100000:3.0:1788581201.695694:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014270464 00000100:00100000:3.0:1788581201.695798:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788581201.695807:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014270464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788581201.695823:0:12526:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1788581201.695848:0:12526:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9b954f, atime: 0x6a9b954f, ctime: 0x6a9b954f, blocks: 0xb 00010000:00010000:3.0:1788581201.695855:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a70f0c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.695867:0:12526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=417s v=(0 0) 00010000:00010000:3.0:1788581201.695871:0:12526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581201.695877:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a70f0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.695891:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a70f0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.695907:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a70f0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.695915:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a70f0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.695931:0:12526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788581201.696436:0:10329:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788581201.696440:0:10329:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788581201 00002000:00010000:1.0:1788581201.696443:0:10329:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788581201.696445:0:10329:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788581201 -> 1788581201 00002000:00010000:1.0:1788581201.696448:0:10329:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788581201.696497:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3340:x1875463014270208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1551us (1900us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788581201.696506:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788581201.697053:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+20:11630:x1875462995409024:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 Request processed in 104223us (104714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581201.697062:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 227 00010000:00010000:0.0:1788581201.697089:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581201.697096:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a70f0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.697106:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce000 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581201.697111:0:5865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a70f0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.697134:0:5865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a70f0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.697155:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a70f0c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.697163:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a70f0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.697182:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581201.697189:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581201.697191:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788581201.697634:0:3340:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9190474c0a80/2, rc 0, transno 4294967321 00000100:00100000:2.0:1788581201.697642:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014270208:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788581201.702878:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014270464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7063us (7317us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788581201.702893:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788581201.703631:0:3338:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1788581201.703639:0:3338:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff919075b74e00, transno 4294967307 00000004:00080000:2.0:1788581201.703657:0:3338:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:2.0:1788581201.703681:0:3338:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff91907f715f80 x1875463014270464/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788581217 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788581201.703694:0:3338:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91907f715f80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788581201.703699:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014270464:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788581201.708464:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581201.708558:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995409152 00000100:00100000:2.0:1788581201.708567:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995409152 00010000:00010000:2.0:1788581201.708605:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a70cc7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92f7 expref: 13 pid: 6725 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581201.708661:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 82 00000100:00100000:2.0:1788581201.708671:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:2374:x1875462995409152:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581201.708685:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581201.708691:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a70cc7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92f7 expref: 13 pid: 6725 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.708717:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a70cc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92f7 expref: 13 pid: 6725 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.708741:0:5861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581201.708746:0:5861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581201.708751:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b84d77e7/0xf54e3944c2a70f05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.708762:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b84d77e7/0xf54e3944c2a70f05 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.708779:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581201.708826:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+13:2374:x1875462995409152:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 156us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581201.708833:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 82 00010000:00010000:1.0:1788581201.708939:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a70cc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92f7 expref: 12 pid: 6725 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581201.708952:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6725:1875463014270336:192.168.201.13@tcp:104: 00010000:00010000:1.0:1788581201.708981:0:6725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b84d77e7/0xf54e3944c2a70f05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.708992:0:6725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b84d77e7/0xf54e3944c2a70f05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.709006:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b84d77e7/0xf54e3944c2a70f05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.709015:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b84d77e7/0xf54e3944c2a70f05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.709022:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b84d77e7/0xf54e3944c2a70f05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.709043:0:6725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581201.709309:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581201.709315:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b84d77e7/0xf54e3944c2a70f05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.709336:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9a00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:2.0:1788581201.709341:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b84d77e7/0xf54e3944c2a70f05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.709350:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b84d77e7/0xf54e3944c2a70f05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.709363:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b84d77e7/0xf54e3944c2a70f05 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.709371:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b84d77e7/0xf54e3944c2a70f05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.709387:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581201.709389:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581201.709391:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581201.709874:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3340:x1875463014270080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15156us (15373us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788581201.709883:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:2.0:1788581201.709970:0:3340:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9190474c3800/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788581201.709977:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014270080:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788581201.710657:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581201.710713:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995409280 00000100:00100000:3.0:1788581201.710719:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995409280 00000100:00100000:3.0:1788581201.710764:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 68 00000100:00100000:3.0:1788581201.710772:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+12:2374:x1875462995409280:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788581201.790624:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1788581201.790642:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:2.0:1788581201.790660:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1788581201.795528:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2374:x1875462995409280:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 Request processed in 84744us (84862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581201.795542:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 68 00000100:00100000:2.0:1788581201.816343:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581201.816451:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995409536 00000100:00100000:0.0:1788581201.816462:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995409536 00000100:00100000:0.0:1788581201.816524:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 228 00000100:00100000:0.0:1788581201.816535:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+20:11630:x1875462995409536:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788581201.816588:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581201.816616:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70ef0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d938a expref: 20 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.816636:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91904995a200) 00010000:00010000:0.0:1788581201.816641:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581201.816674:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70f13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.816688:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70f13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.816697:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70f13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581201.816950:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000537f2b65 reply state 000000008b6c0f41 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70f13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581201.816960:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788581201.817062:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+21:11630:x1875462995409536:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 527us (727us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788581201.817070:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 228 00010000:00010000:2.0:1788581201.824596:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70f13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.824613:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70f13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.824620:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70f13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.824627:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23e00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581201.824632:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70f13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.824640:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70f13 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.824657:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91904995a200) 00010000:00010000:2.0:1788581201.824660:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581201.824664:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70f13 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.824670:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70f13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581201.834157:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581201.834503:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995409664 00000100:00100000:1.0:1788581201.834513:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995409664 00000100:00100000:1.0:1788581201.834571:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 69 00000100:00100000:1.0:1788581201.834582:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2375:x1875462995409664:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788581201.834848:0:10329:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788581201.834853:0:10329:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788581201 -> 1788581200 00002000:00010000:1.0:1788581201.834856:0:10329:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788581199 00002000:00010000:1.0:1788581201.834858:0:10329:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788581201 -> 1788581200 00002000:00010000:1.0:1788581201.834861:0:10329:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788581201.834931:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2375:x1875462995409664:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 350us (785us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788581201.834940:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 69 00000100:00100000:3.0:1788581201.839327:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581201.840564:0:12524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995409920 00000100:00100000:1.0:1788581201.840578:0:12524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995409920 00000100:00100000:1.0:1788581201.840649:0:12524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 229 00000100:00100000:1.0:1788581201.840660:0:12524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11f1870a-1d9b-4af2-bb25-e81f8742df75+20:11630:x1875462995409920:12345-192.168.201.13@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788581201.840756:0:12524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70f1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.840773:0:12524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70ed4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d937c expref: 20 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.840783:0:12524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70f1a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.840818:0:12524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d937c expref: 20 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.840831:0:12524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d937c expref: 20 pid: 5878 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581201.840847:0:12524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12524:1875463014270592:192.168.201.13@tcp:104: 00000100:00100000:1.0:1788581201.841128:0:12524:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906ca866c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581201.845695:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581201.845824:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995410048 00000100:00100000:3.0:1788581201.845834:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995410048 00010000:00010000:3.0:1788581201.845873:0:6739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70ed4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d937c expref: 21 pid: 5878 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581201.845919:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 83 00000100:00100000:3.0:1788581201.845930:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+21:2374:x1875462995410048:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581201.845954:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581201.845962:0:6739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70ed4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d937c expref: 21 pid: 5878 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.845994:0:6739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d937c expref: 21 pid: 5878 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.846017:0:6739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91904995a200) 00010000:00010000:3.0:1788581201.846022:0:6739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70f1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.846031:0:6739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70f1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.846039:0:6739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70f1a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581201.846056:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581201.846355:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+21:2374:x1875462995410048:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 425us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581201.846364:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 83 00010000:00010000:1.0:1788581201.846635:0:12524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70ed4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d937c expref: 20 pid: 5878 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581201.846653:0:12524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12524:1875463014270592:192.168.201.13@tcp:104: 00010000:00010000:1.0:1788581201.846671:0:12524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70f1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.846693:0:12524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70f1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.846698:0:12524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70f1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.846748:0:12524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70f1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.846755:0:12524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70f1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.846762:0:12524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70f1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.846768:0:12524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581201.846773:0:12524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70f1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.846781:0:12524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70f1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.846791:0:12524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91904995a200) 00010000:00010000:1.0:1788581201.846794:0:12524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788581201.846798:0:12524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70f1a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.846804:0:12524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8400/0xf54e3944c2a70f1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581201.846847:0:12524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:11630:x1875462995409920:12345-192.168.201.13@tcp:55:lhsmtool_posix.0 Request processed in 6190us (7535us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788581201.846861:0:12524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 229 00000100:00100000:2.0:1788581201.858040:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581201.858190:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995410176 00000100:00100000:1.0:1788581201.858200:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995410176 00000100:00100000:1.0:1788581201.858290:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 70 00000100:00100000:1.0:1788581201.858301:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2372:x1875462995410176:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788581201.858341:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70f21 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.858362:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5de672d/0xf54e3944c2a70efe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9398 expref: 8 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.858371:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788581201.858375:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788581201.858379:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70f21 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.858414:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5de672d/0xf54e3944c2a70efe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9398 expref: 8 pid: 6722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.858428:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5de672d/0xf54e3944c2a70efe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9398 expref: 8 pid: 6722 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581201.858443:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6725:1875463014270720:192.168.201.13@tcp:104: 00000100:00100000:1.0:1788581201.858526:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906ca866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581201.869389:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581201.870093:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6725:1875463014270720:192.168.201.13@tcp:104: 00010000:00010000:1.0:1788581201.870147:0:6725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70f21 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581201.870326:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995410304 00000100:00100000:2.0:1788581201.870335:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995410304 00010000:00010000:2.0:1788581201.870375:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5de672d/0xf54e3944c2a70efe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9398 expref: 9 pid: 6722 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581201.870442:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 84 00000100:00100000:2.0:1788581201.870452:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+9:2375:x1875462995410304:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581201.870469:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581201.870492:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5de672d/0xf54e3944c2a70efe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9398 expref: 9 pid: 6722 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.870506:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5de672d/0xf54e3944c2a70efe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9398 expref: 9 pid: 6722 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.870530:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5de672d/0xf54e3944c2a70efe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9398 expref: 9 pid: 6722 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.870547:0:5861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581201.870552:0:5861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788581201.870559:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70f21 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.870569:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70f21 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.870599:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581201.870667:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2375:x1875462995410304:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 216us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581201.870676:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 84 00010000:00010000:1.0:1788581201.870898:0:6725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70f21 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.870907:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70f21 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.870933:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70f21 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.870942:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70f21 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.870962:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70f21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.870969:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8400 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581201.870974:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70f21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.870983:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70f21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.870995:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70f21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.871009:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eadc4291/0xf54e3944c2a70f21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581201.871054:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2372:x1875462995410176:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 Request processed in 12756us (13024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581201.871064:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 70 00000100:00100000:2.0:1788581201.879712:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581201.879853:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995410560 00000100:00100000:0.0:1788581201.879865:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995410560 00000100:00100000:0.0:1788581201.879936:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 230 00000100:00100000:0.0:1788581201.880110:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:11630:x1875462995410560:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788581201.880198:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70f28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.880215:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70f28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.880228:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70f28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.880504:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70f2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.880517:0:9658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ee2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9383 expref: 20 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.880525:0:9658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70f2f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.880572:0:9658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9383 expref: 20 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.880587:0:9658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ee2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9383 expref: 20 pid: 5877 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581201.880603:0:9658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9658:1875463014270848:192.168.201.13@tcp:104: 00000100:00100000:0.0:1788581201.880766:0:9658:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f4357fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581201.895103:0:9658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9658:1875463014270848:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581201.895927:0:9658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70f2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581201.898860:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581201.898976:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995410688 00000100:00100000:1.0:1788581201.898987:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995410688 00010000:00010000:1.0:1788581201.899029:0:5863:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ee2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9383 expref: 21 pid: 5877 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581201.899068:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 85 00000100:00100000:1.0:1788581201.899078:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+21:2375:x1875462995410688:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581201.899093:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581201.899102:0:5863:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ee2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9383 expref: 21 pid: 5877 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.899128:0:5863:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9383 expref: 21 pid: 5877 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.899152:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62600/0xf54e3944c2a70ee2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9383 expref: 21 pid: 5877 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.899171:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91904995a200) 00010000:00010000:1.0:1788581201.899177:0:5863:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70f2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.899204:0:5863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70f2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.899212:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70f2f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581201.899295:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581201.899354:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+20:2375:x1875462995410688:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 276us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581201.899362:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 85 00010000:00010000:2.0:1788581201.899464:0:9658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70f2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.899472:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70f2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581201.899659:0:9658:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788581201.899830:0:9658:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788581201.899876:0:9658:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788581201.899961:0:9658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919047c58380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9658:1875463014270976:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788581201.900014:0:9658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581201.900046:0:9658:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f43587e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581201.900068:0:5882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014270976 00000100:00100000:2.0:1788581201.900073:0:5882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014270976 00000100:00100000:2.0:1788581201.900106:0:5882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788581201.900114:0:5882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9658:x1875463014270976:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788581201.900184:0:5882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9658:x1875463014270976:12345-0@lo:1000:mdt00_003.0 Request processed in 72us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581201.900191:0:5882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788581201.900227:0:9658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788581201.900232:0:9658:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:2.0:1788581201.900276:0:9658:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9190474c0a80, transno 4294967321 00000004:00080000:2.0:1788581201.900291:0:9658:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9190474c3800, transno 4294967322 00000100:00100000:2.0:1788581201.900298:0:9658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919047c58380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9658:1875463014270976:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788581201.900825:0:9658:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788581201.900884:0:9658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9658:1875463014271104:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788581201.900938:0:9658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581201.900960:0:9658:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f43587b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581201.900977:0:5882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014271104 00000100:00100000:2.0:1788581201.900981:0:5882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014271104 00000100:00100000:2.0:1788581201.901010:0:5882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788581201.901017:0:5882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9658:x1875463014271104:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788581201.901171:0:5882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9658:x1875463014271104:12345-0@lo:1000:mdt00_003.0 Request processed in 154us (232us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788581201.901179:0:5882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788581201.901217:0:9658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9658:1875463014271104:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788581201.901266:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70f2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.901277:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70f2f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.901285:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70f2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.901291:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581201.901296:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70f2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.901303:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70f2f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.901318:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91904995a200) 00010000:00010000:2.0:1788581201.901321:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788581201.901325:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70f2f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.901342:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70f2f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.901372:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70e72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.901378:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70e72 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.901385:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70e72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.901390:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581201.901393:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70e72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.901399:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70e72 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.901408:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:2.0:1788581201.901410:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788581201.901416:0:9658:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70e79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9367 expref: 23 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.901427:0:9658:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70e79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9367 expref: 23 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.901436:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70e79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9367 expref: 23 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.901470:0:9658:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70e79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9367 expref: 23 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581201.901482:0:9658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190484ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9658:1875463014271232:192.168.201.13@tcp:105: 00000100:00100000:2.0:1788581201.901534:0:9658:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f43587b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581201.928593:0:9658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190484ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9658:1875463014271232:192.168.201.13@tcp:105: 00010000:00010000:2.0:1788581201.928626:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70e72 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928638:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf800/0xf54e3944c2a70e72 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928681:0:9658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f36 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928696:0:9658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928719:0:9658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928730:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928735:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f36 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928742:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f36 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928769:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb62a00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581201.928773:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f36 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928780:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f36 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928793:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:2.0:1788581201.928796:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581201.928801:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f36 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928806:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f36 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928816:0:9658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70f28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928822:0:9658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70f28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928828:0:9658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70f28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928832:0:9658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581201.928835:0:9658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70f28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928840:0:9658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70f28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928859:0:9658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:2.0:1788581201.928861:0:9658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788581201.928864:0:9658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70f28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.928870:0:9658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70f28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581201.929211:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+23:11630:x1875462995410560:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 49263us (49516us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788581201.929221:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 230 00000020:00080000:2.0:1788581201.929227:0:9658:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788581201.938751:0:11735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788581201.938760:0:11735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788581201.939325:0:11735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788581201.939335:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788581201.941367:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581201.941563:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995410816 00000100:00100000:3.0:1788581201.941573:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995410816 00000100:00100000:3.0:1788581201.941632:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 61 00000100:00100000:3.0:1788581201.941643:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+23:11629:x1875462995410816:12345-192.168.201.13@tcp:49:lfs.0 00000100:00100000:3.0:1788581201.941791:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+23:11629:x1875462995410816:12345-192.168.201.13@tcp:49:lfs.0 Request processed in 149us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581201.941817:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 61 00000100:00100000:3.0:1788581201.949672:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581201.952726:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581201.952816:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995411328 00000100:00100000:3.0:1788581201.952826:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995411328 00000100:00100000:3.0:1788581201.952885:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 231 00000100:00100000:3.0:1788581201.952895:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+23:11629:x1875462995411328:12345-192.168.201.13@tcp:58:lfs.0 00000040:00080000:3.0:1788581201.953324:0:5878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788581201.953407:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+23:11629:x1875462995411328:12345-192.168.201.13@tcp:58:lfs.0 Request processed in 511us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581201.953415:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 231 00000100:00100000:2.0:1788581201.954391:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995411072 00000100:00100000:2.0:1788581201.954401:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995411072 00000100:00100000:2.0:1788581201.954448:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 62 00000100:00100000:2.0:1788581201.954459:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190673cd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+23:11630:x1875462995411072:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788581201.955044:0:5880:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788581201.955155:0:5880:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788581201.955202:0:5880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.955219:0:5880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.955230:0:5880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.956419:0:5880:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f3d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.956434:0:5880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f3d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.956440:0:5880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581201.957079:0:5880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788581201.957211:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190673cd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+25:11630:x1875462995411072:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 2746us (7542us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788581201.957222:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 62 00000020:00080000:2.0:1788581201.957227:0:5880:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788581201.962294:0:6738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581201.962309:0:6738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.962321:0:6738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb62a00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581201.962325:0:6738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.962335:0:6738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.962353:0:6738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91905c525e00) 00010000:00010000:0.0:1788581201.962357:0:6738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788581201.962361:0:6738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f3d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.962367:0:6738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62a00/0xf54e3944c2a70f3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581201.962390:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581201.962393:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581201.962395:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581201.968431:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581202.038623:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581202.038739:0:12524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995411456 00000100:00100000:0.0:1788581202.038749:0:12524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995411456 00000100:00100000:0.0:1788581202.038816:0:12524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 232 00000100:00100000:0.0:1788581202.038827:0:12524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11f1870a-1d9b-4af2-bb25-e81f8742df75+25:11632:x1875462995411456:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1788581202.038852:0:12524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581202.038939:0:12524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70f44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d939f expref: -99 pid: 12524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.039035:0:12524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70f4b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.039051:0:12524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70f4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.039063:0:12524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70f4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.039081:0:12524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70f52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.039089:0:12524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70f52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.039096:0:12524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70f52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.039418:0:12524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70f59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.039431:0:12524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70e64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9360 expref: 26 pid: 12524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.039440:0:12524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70f59 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.039472:0:12524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70e64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9360 expref: 26 pid: 12524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.039498:0:12524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70e64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9360 expref: 26 pid: 12524 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581202.039513:0:12524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12524:1875463014271360:192.168.201.13@tcp:104: 00000100:00100000:0.0:1788581202.039605:0:12524:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f4357f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788581202.046945:0:12524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12524:1875463014271360:192.168.201.13@tcp:104: 00010000:00010000:0.0:1788581202.046994:0:12524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70f59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581202.059034:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581202.061471:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995411712 00000100:00100000:2.0:1788581202.061486:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995411712 00000100:00100000:2.0:1788581202.061566:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 63 00000100:00100000:2.0:1788581202.061578:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+27:5611:x1875462995411712:12345-192.168.201.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788581202.061912:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+28:5611:x1875462995411712:12345-192.168.201.13@tcp:35:ldlm_bl.0 Request processed in 334us (2886us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788581202.061920:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 63 00000100:00100000:3.0:1788581202.066237:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581202.066402:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995411840 00000100:00100000:2.0:1788581202.066412:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995411840 00010000:00010000:2.0:1788581202.066461:0:5861:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70e64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9360 expref: 28 pid: 12524 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581202.066501:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 86 00000100:00100000:2.0:1788581202.066512:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076315880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+28:2375:x1875462995411840:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581202.066597:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581202.066605:0:5861:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70e64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9360 expref: 28 pid: 12524 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581202.066620:0:5861:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70e64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9360 expref: 28 pid: 12524 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581202.066642:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23600/0xf54e3944c2a70e64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9360 expref: 28 pid: 12524 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581202.066661:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:2.0:1788581202.066666:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70f59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581202.066675:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581202.066684:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70f59 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581202.066876:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581202.066935:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076315880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+27:2375:x1875462995411840:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 424us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581202.066944:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 86 00010000:00010000:0.0:1788581202.069037:0:12524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069055:0:12524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581202.069123:0:12524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788581202.069128:0:12524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788581202.069151:0:12524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069168:0:12524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069179:0:12524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70f4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069187:0:12524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70f4b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069217:0:12524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70f4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069223:0:12524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581202.069228:0:12524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70f4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069237:0:12524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70f4b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069412:0:12524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:0.0:1788581202.069416:0:12524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581202.069420:0:12524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70f4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069437:0:12524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70f4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069455:0:12524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70f52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069462:0:12524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70f52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069468:0:12524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70f52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069474:0:12524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23a00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581202.069477:0:12524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70f52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069494:0:12524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70f52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069503:0:12524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91904995aa00) 00010000:00010000:0.0:1788581202.069505:0:12524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581202.069509:0:12524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70f52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069515:0:12524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23a00/0xf54e3944c2a70f52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069554:0:12524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23e00/0xf54e3944c2a70f44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d939f expref: 27 pid: 12524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069569:0:12524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70f59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d939f expref: 26 pid: 12524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581202.069577:0:12524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:0.0:1788581202.069579:0:12524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581202.069582:0:12524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc23800, rc 0) 00000100:00100000:0.0:1788581202.069708:0:12524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11f1870a-1d9b-4af2-bb25-e81f8742df75+26:11632:x1875462995411456:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 30872us (31086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581202.069726:0:12524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 232 00000040:00080000:0.0:1788581202.917607:0:12565:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788581202.917616:0:12565:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788581202.917675:0:12565:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788581202.917693:0:12565:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788581202.996973:0:11735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788581202.996998:0:11735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788581202.997056:0:11735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788581202.997063:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788581202.997202:0:11735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11735:1875463014271488:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788581202.997342:0:11735:0:(client.c:2715:ptlrpc_set_wait()) set ffff919041254840 going to sleep for 11 seconds 00000100:00100000:1.0:1788581203.007480:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581203.007548:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995411968 00000100:00100000:1.0:1788581203.007557:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995411968 00000100:00100000:1.0:1788581203.007621:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 233 00000100:00100000:1.0:1788581203.007632:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+27:11644:x1875462995411968:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788581203.007669:0:9658:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788581203.007789:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+27:11644:x1875462995411968:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 158us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581203.007798:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 233 00000100:00080000:1.0:1788581203.007982:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581203.008379:0:11735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11735:1875463014271488:192.168.201.13@tcp:107:hsm_cdtr.0 00010000:00010000:2.0:1788581203.010042:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581203.021612:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581203.022839:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995412224 00000100:00100000:0.0:1788581203.022852:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995412224 00000100:00100000:0.0:1788581203.022919:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 234 00000100:00100000:0.0:1788581203.022931:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+26:11644:x1875462995412224:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581203.022951:0:5876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581203.022973:0:5876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70f60 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d93a6 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581203.023075:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70f67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581203.023090:0:5876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581203.023114:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581203.023136:0:5876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788581203.023282:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70f60 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d93a6 expref: 29 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581203.023299:0:5876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70f67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d93a6 expref: 28 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581203.023322:0:5876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:0.0:1788581203.023325:0:5876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788581203.023329:0:5876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22200, rc 0) 00000100:00100000:0.0:1788581203.023397:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+28:11644:x1875462995412224:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 469us (1792us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788581203.023404:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 234 00000100:00100000:1.0:1788581203.033341:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581203.033493:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581203.033582:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995412608 00000100:00100000:2.0:1788581203.033592:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995412608 00000100:00100000:2.0:1788581203.033662:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:2.0:1788581203.033690:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049af3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+28:2375:x1875462995412608:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581203.033708:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581203.033734:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22200/0xf54e3944c2a70f67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d93a6 expref: 28 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581203.033752:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:2.0:1788581203.033757:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581203.033820:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049af3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+27:2375:x1875462995412608:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 141us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581203.033827:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:0.0:1788581203.035976:0:12524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995412480 00000100:00100000:0.0:1788581203.035990:0:12524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995412480 00000100:00100000:1.0:1788581203.036280:0:12524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 235 00000100:00100000:1.0:1788581203.036291:0:12524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190474c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11f1870a-1d9b-4af2-bb25-e81f8742df75+27:11644:x1875462995412480:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788581203.036371:0:12524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70f75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581203.036388:0:12524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581203.036400:0:12524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581203.036610:0:12524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581203.036618:0:12524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70f75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581203.036625:0:12524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70f75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581203.036630:0:12524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9e00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581203.036634:0:12524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70f75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581203.036641:0:12524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70f75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581203.036653:0:12524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:1.0:1788581203.036656:0:12524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788581203.036662:0:12524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70f75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581203.036675:0:12524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9e00/0xf54e3944c2a70f75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581203.036826:0:12524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190474c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11f1870a-1d9b-4af2-bb25-e81f8742df75+28:11644:x1875462995412480:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 536us (3493us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788581203.036835:0:12524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 235 00000040:00080000:0.0:1788581203.037473:0:11735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788581203.037479:0:11735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788581203.037947:0:11735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788581203.037957:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788581203.044399:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581203.046853:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995412864 00000100:00100000:0.0:1788581203.046869:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995412864 00000100:00100000:0.0:1788581203.046935:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 64 00000100:00100000:0.0:1788581203.046947:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+28:11644:x1875462995412864:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788581203.047521:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+29:11644:x1875462995412864:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 574us (3131us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788581203.047530:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 64 00000100:00100000:3.0:1788581203.055488:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581203.055515:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014271616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581203.055581:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581203.055714:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014271616 00000100:00100000:0.0:1788581203.055722:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014271616 00000100:00100000:0.0:1788581203.055813:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788581203.055823:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014271616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581203.055861:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581203.055921:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014271616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581203.055937:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788581203.055986:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014271616:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788581203.056076:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788581204.015959:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581204.940872:0:12616:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788581204.940883:0:12616:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788581204.940930:0:12616:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788581204.940936:0:12616:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788581205.039816:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581205.212394:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581205.213003:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995413120 00000100:00100000:3.0:1788581205.213015:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995413120 00000100:00100000:2.0:1788581205.213317:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 236 00000100:00100000:2.0:1788581205.213330:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+29:11665:x1875462995413120:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1788581205.213358:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581205.213379:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62200/0xf54e3944c2a70f7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d93ad expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581205.213497:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a70f83 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581205.213511:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a70f83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581205.213522:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a70f83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581205.213533:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788581205.214009:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62200/0xf54e3944c2a70f7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d93ad expref: 32 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581205.214052:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a70f83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d93ad expref: 31 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581205.214071:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:2.0:1788581205.214074:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788581205.214084:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91906cb63400, rc 0) 00000100:00100000:2.0:1788581205.214153:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+31:11665:x1875462995413120:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 826us (1769us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788581205.214161:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 236 00000100:00080000:1.0:1788581205.217446:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581205.218031:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581205.218089:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995413248 00000100:00100000:3.0:1788581205.218100:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995413248 00000100:00100000:3.0:1788581205.218158:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 237 00000100:00100000:3.0:1788581205.218169:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c96ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+31:11665:x1875462995413248:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:3.0:1788581205.218259:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70f91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581205.218277:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70f91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581205.218289:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70f91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581205.218326:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70f91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581205.218331:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70f91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581205.218337:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70f91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581205.218340:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581205.218343:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70f91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581205.218348:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70f91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581205.218357:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:3.0:1788581205.218359:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581205.218363:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70f91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581205.218366:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf200/0xf54e3944c2a70f91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581205.218438:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c96ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+31:11665:x1875462995413248:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 260us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581205.218446:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 237 00000100:00100000:3.0:1788581205.344316:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581205.344471:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995413376 00000100:00100000:2.0:1788581205.344483:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995413376 00000100:00100000:2.0:1788581205.344630:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 71 00000100:00100000:2.0:1788581205.344652:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2373:x1875462995413376:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:2.0:1788581205.344685:0:6723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581205.344709:0:6723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eba93fc8/0xf54e3944c2a70f98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d93b4 expref: -99 pid: 6723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788581205.344738:0:6723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9b9550, atime: 0x6a9b954f, ctime: 0x6a9b9550, blocks: 0xb 00010000:00010000:2.0:1788581205.344759:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1788581205.344765:0:6723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581205.344775:0:6723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eba93fc8/0xf54e3944c2a70f98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d93b4 expref: 8 pid: 6723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581205.344793:0:6723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eba93fc8/0xf54e3944c2a70f98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d93b4 expref: 8 pid: 6723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581205.344826:0:6723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91906cb62200, rc 0) 00000100:00100000:2.0:1788581205.344890:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2373:x1875462995413376:12345-192.168.201.13@tcp:101:cat.0 Request processed in 250us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581205.344897:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 71 00000100:00080000:1.0:1788581205.347290:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581205.365945:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581205.366060:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995413504 00000100:00100000:2.0:1788581205.366071:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995413504 00002000:00100000:2.0:1788581205.366126:0:6729:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff91907f870e00 x1875462995413504/t0(0) o3->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:561/0 lens 488/0 e 0 to 0 dl 1788581216 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788581205.366137:0:6729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91907f870e00 with x1875462995413504 ext(0->4095) 00002000:00010000:2.0:1788581205.366144:0:6729:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91907f870e00 00000100:00100000:2.0:1788581205.366180:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:2.0:1788581205.366191:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2374:x1875462995413504:12345-192.168.201.13@tcp:3:cat.0 00000100:00100000:2.0:1788581205.366433:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2374:x1875462995413504:12345-192.168.201.13@tcp:3:cat.0 Request processed in 242us (498us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788581205.366442:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00002000:00100000:2.0:1788581205.366448:0:6729:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff91907f870e00 x1875462995413504/t0(0) o3->11f1870a-1d9b-4af2-bb25-e81f8742df75@192.168.201.13@tcp:561/0 lens 488/4536 e 0 to 0 dl 1788581216 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788581205.366457:0:6729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91907f870e00 with x1875462995413504 ext(0->4095) 00002000:00010000:2.0:1788581205.366460:0:6729:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91907f870e00 00000100:00100000:0.0:1788581205.620288:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014272000:0@lo:400:kworker.0 00000100:00100000:0.0:1788581205.620363:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581205.620479:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581205.620486:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c61e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014272128:0@lo:400:kworker.0 00000100:00100000:0.0:1788581205.620513:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581205.620693:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014271872:0@lo:400:kworker.0 00000100:00100000:1.0:1788581205.620726:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581205.620758:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014272384:0@lo:400:kworker.0 00000100:00100000:1.0:1788581205.620780:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581205.620802:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788581205.620807:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c60d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014271744:0@lo:400:kworker.0 00000100:00100000:1.0:1788581205.620836:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581205.620857:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3341:1875463014272256:0@lo:400:kworker.0 00000100:00100000:1.0:1788581205.620877:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581205.620909:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014272128 00000100:00100000:1.0:1788581205.620919:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014272128 00000100:00100000:1.0:1788581205.620983:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014272384 00000100:00100000:1.0:1788581205.620987:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014272384 00000100:00100000:1.0:1788581205.621012:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788581205.621021:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014272128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581205.621087:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014272128:12345-0@lo:400:kworker.0 Request processed in 67us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581205.621095:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788581205.621113:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788581205.621119:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3341:x1875463014272384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581205.621150:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3341:x1875463014272384:12345-0@lo:400:kworker.0 Request processed in 31us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581205.621156:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1788581205.621176:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788581205.621179:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581205.621206:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014272384:0@lo:400:kworker.0 00000100:00100000:0.0:1788581205.621380:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014271744 00000100:00100000:0.0:1788581205.621385:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014271744 00000100:00100000:0.0:1788581205.621427:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788581205.621434:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014271744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581205.621489:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014271744:12345-0@lo:400:kworker.0 Request processed in 56us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581205.621495:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788581205.621524:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014272000 00000100:00100000:0.0:1788581205.621528:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014272000 00000100:00100000:0.0:1788581205.621560:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014271872 00000100:00100000:0.0:1788581205.621564:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014271872 00000100:00100000:0.0:1788581205.621578:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014272256 00000100:00100000:0.0:1788581205.621581:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014272256 00000100:00100000:0.0:1788581205.621595:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788581205.621610:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014272000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581205.621668:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014272000:12345-0@lo:400:kworker.0 Request processed in 58us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581205.621675:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788581205.621688:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788581205.621694:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014271872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581205.621724:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014271872:12345-0@lo:400:kworker.0 Request processed in 31us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581205.621729:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788581205.621739:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788581205.621745:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3341:x1875463014272256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581205.621771:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3341:x1875463014272256:12345-0@lo:400:kworker.0 Request processed in 27us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581205.621776:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:0.0:1788581205.621793:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581205.621813:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014271744:0@lo:400:kworker.0 00000100:00100000:0.0:1788581205.621824:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3341:1875463014272256:0@lo:400:kworker.0 00000100:00100000:0.0:1788581205.621834:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c60e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014271872:0@lo:400:kworker.0 00000100:00100000:0.0:1788581205.621870:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014272128:0@lo:400:kworker.0 00000100:00100000:0.0:1788581205.621883:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c61dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014272000:0@lo:400:kworker.0 00000100:00100000:0.0:1788581205.896338:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581205.896391:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581205.896429:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581205.896482:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581205.896504:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581205.896536:0:12524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995413760 00000100:00100000:0.0:1788581205.896546:0:12524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995413760 00000100:00100000:0.0:1788581205.896594:0:12524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995414144 00000100:00100000:0.0:1788581205.896598:0:12524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995414144 00000100:00100000:0.0:1788581205.896627:0:12524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 172 00000100:00100000:0.0:1788581205.896648:0:12524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11f1870a-1d9b-4af2-bb25-e81f8742df75+31:2374:x1875462995413760:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581205.896737:0:12524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11f1870a-1d9b-4af2-bb25-e81f8742df75+31:2374:x1875462995413760:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 92us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581205.896745:0:12524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 172 00000100:00100000:0.0:1788581205.896762:0:12524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 173 00000100:00100000:0.0:1788581205.896768:0:12524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995414144:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581205.896790:0:12524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2374:x1875462995414144:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 22us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581205.896796:0:12524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 173 00000100:00080000:0.0:1788581205.896813:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581205.896983:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995413632 00000100:00100000:1.0:1788581205.896988:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995413632 00000100:00100000:1.0:1788581205.897024:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 305 00000100:00100000:1.0:1788581205.897032:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995413632:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581205.897060:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995413632:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 29us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581205.897066:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 305 00000100:00100000:1.0:1788581205.897093:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995414016 00000100:00100000:1.0:1788581205.897097:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995414016 00000100:00100000:1.0:1788581205.897124:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995413888 00000100:00100000:1.0:1788581205.897127:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995413888 00000100:00100000:1.0:1788581205.897145:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 101 00000100:00100000:1.0:1788581205.897152:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995414016:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581205.897178:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2374:x1875462995414016:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 26us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581205.897195:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 101 00000100:00100000:1.0:1788581205.897208:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 102 00000100:00100000:1.0:1788581205.897213:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2374:x1875462995413888:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581205.897270:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+8:2374:x1875462995413888:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 28us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581205.897278:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 102 00000100:00080000:1.0:1788581205.897298:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788581206.066495:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581206.127659:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014272512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581206.127737:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581206.127943:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014272512 00000100:00100000:1.0:1788581206.127952:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014272512 00000100:00100000:1.0:1788581206.127999:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788581206.128009:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014272512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581206.128045:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581206.128100:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014272512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581206.128107:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788581206.128268:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014272512:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788581206.744171:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1788581206.755193:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:1.0:1788581206.755224:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1788581206.755238:0:5899:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff918f435879c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788581206.755265:0:5899:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91907fcc5f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff918f43587e40 00000020:00080000:1.0:1788581206.755269:0:5899:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91907fcc5100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91906c947000 00000020:00080000:1.0:1788581206.755289:0:5899:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1788581206.756360:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788581206.756577:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1788581207.089973:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788581207.195274:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1788581207.195292:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:1.0:1788581208.111776:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581208.179164:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581208.179210:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014272640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581208.179310:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581208.179419:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014272640 00000100:00100000:1.0:1788581208.179428:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014272640 00000100:00100000:1.0:1788581208.179508:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788581208.179520:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014272640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581208.179558:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581208.179615:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014272640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581208.179622:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788581208.179645:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581208.179671:0:3338:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788581208.179676:0:3338:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788581208.179704:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014272640:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788581209.136510:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581210.159683:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581210.735998:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919047c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014273152:0@lo:400:kworker.0 00000100:00100000:2.0:1788581210.736101:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581210.736163:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581210.736169:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919047c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014273024:0@lo:400:kworker.0 00000100:00100000:2.0:1788581210.736197:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581210.736239:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014273152 00000100:00100000:2.0:1788581210.736271:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014273152 00000100:00100000:2.0:1788581210.736343:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788581210.736353:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014273152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581210.736415:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014273152:12345-0@lo:400:kworker.0 Request processed in 62us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581210.736423:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788581210.736451:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014273024 00000100:00100000:2.0:1788581210.736455:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014273024 00000100:00100000:0.0:1788581210.736472:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919048580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014272896:0@lo:400:kworker.0 00000100:00100000:2.0:1788581210.736485:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788581210.736493:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014273024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581210.736511:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581210.736558:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f411ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014273408:0@lo:400:kworker.0 00000100:00100000:2.0:1788581210.736892:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014273024:12345-0@lo:400:kworker.0 Request processed in 399us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581210.736899:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788581210.736911:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014272896 00000100:00100000:2.0:1788581210.736915:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014272896 00000100:00100000:2.0:1788581210.736936:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788581210.736941:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014272896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581210.737122:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014272896:12345-0@lo:400:kworker.0 Request processed in 180us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581210.737129:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:2.0:1788581210.737147:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581210.737152:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581210.737196:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919047c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014273024:0@lo:400:kworker.0 00000100:00100000:2.0:1788581210.737208:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919047c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014273152:0@lo:400:kworker.0 00000100:00100000:1.0:1788581210.739091:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c96ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014272768:0@lo:400:kworker.0 00000100:00100000:0.0:1788581210.747506:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581210.747631:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919048580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014272896:0@lo:400:kworker.0 00000100:00100000:0.0:1788581210.747703:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581210.747737:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919047c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014273280:0@lo:400:kworker.0 00000100:00100000:0.0:1788581210.747772:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581210.747797:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014273280 00000100:00100000:0.0:1788581210.747804:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014273280 00000100:00100000:0.0:1788581210.747855:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788581210.747863:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014273280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581210.748156:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014272768 00000100:00100000:3.0:1788581210.748162:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014272768 00000100:00100000:3.0:1788581210.748193:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788581210.748201:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014272768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581210.748219:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014273408 00000100:00100000:1.0:1788581210.748225:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014273408 00000100:00100000:3.0:1788581210.748278:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014272768:12345-0@lo:400:kworker.0 Request processed in 77us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581210.748285:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788581210.748290:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788581210.748298:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014273408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581210.748357:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014273408:12345-0@lo:400:kworker.0 Request processed in 63us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581210.748363:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788581210.748775:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014273280:12345-0@lo:400:kworker.0 Request processed in 911us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581210.748783:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1788581210.748802:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581210.748807:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581210.748831:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919047c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014273280:0@lo:400:kworker.0 00000100:00100000:0.0:1788581210.748853:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c96ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014272768:0@lo:400:kworker.0 00000100:00100000:3.0:1788581210.748878:0:3341:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788581210.748885:0:3341:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91907f715f80, transno 4294967310 00000100:00100000:3.0:1788581210.748902:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f411ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014273408:0@lo:400:kworker.0 00000100:00100000:3.0:1788581211.016063:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581211.016103:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581211.016130:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581211.016174:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581211.016211:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581211.016264:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995414272 00000100:00100000:3.0:1788581211.016275:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995414272 00000100:00100000:3.0:1788581211.016324:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 307 00000100:00100000:3.0:1788581211.016335:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2373:x1875462995414272:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581211.016403:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2373:x1875462995414272:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 70us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581211.016411:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 307 00000100:00100000:3.0:1788581211.016445:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995414528 00000100:00100000:3.0:1788581211.016449:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995414528 00000100:00100000:3.0:1788581211.016512:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995414656 00000100:00100000:3.0:1788581211.016522:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995414656 00000100:00100000:3.0:1788581211.016561:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 105 00000100:00100000:3.0:1788581211.016569:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2373:x1875462995414528:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581211.016613:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2373:x1875462995414528:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 44us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581211.016620:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 105 00000100:00100000:3.0:1788581211.016633:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 106 00000100:00100000:3.0:1788581211.016640:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2373:x1875462995414656:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581211.016666:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2373:x1875462995414656:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 26us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581211.016672:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 106 00000100:00100000:3.0:1788581211.016693:0:12524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995414784 00000100:00100000:3.0:1788581211.016697:0:12524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995414784 00000100:00100000:3.0:1788581211.016722:0:12524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995414400 00000100:00100000:3.0:1788581211.016724:0:12524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995414400 00000100:00100000:3.0:1788581211.016742:0:12524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 177 00000100:00100000:3.0:1788581211.016748:0:12524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2373:x1875462995414784:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581211.016774:0:12524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:2373:x1875462995414784:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 26us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581211.016781:0:12524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 177 00000100:00100000:3.0:1788581211.016793:0:12524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 178 00000100:00100000:3.0:1788581211.016799:0:12524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:2373:x1875462995414400:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581211.016822:0:12524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:2373:x1875462995414400:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 23us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581211.016828:0:12524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 178 00000100:00080000:3.0:1788581211.016990:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581211.016995:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581211.016997:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581211.161822:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581211.161934:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995414912 00000100:00100000:2.0:1788581211.161944:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995414912 00000100:00100000:2.0:1788581211.162002:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 238 00000100:00100000:2.0:1788581211.162013:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:11309:x1875462995414912:12345-192.168.201.13@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788581211.162125:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:11309:x1875462995414912:12345-192.168.201.13@tcp:60:lhsmtool_posix.0 Request processed in 113us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581211.162133:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 238 00000100:00100000:3.0:1788581211.173120:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581211.173483:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995415168 00000100:00100000:2.0:1788581211.173493:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995415168 00000100:00100000:2.0:1788581211.173561:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 65 00000100:00100000:2.0:1788581211.173571:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:11309:x1875462995415168:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788581211.173928:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:11309:x1875462995415168:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 357us (817us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788581211.173936:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 65 00010000:00010000:1.0:1788581211.183394:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581211.247536:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581211.247592:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014273536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581211.247664:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581211.247832:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014273536 00000100:00100000:1.0:1788581211.247841:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014273536 00000100:00100000:1.0:1788581211.247920:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788581211.247932:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014273536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581211.247973:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581211.248030:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014273536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581211.248051:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788581211.248145:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014273536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581211.358917:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581211.358990:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995415296 00000100:00100000:0.0:1788581211.359001:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995415296 00000100:00100000:0.0:1788581211.359107:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 239 00000100:00100000:0.0:1788581211.359121:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+5:12117:x1875462995415296:12345-192.168.201.13@tcp:101:lsof.0 00010000:00010000:0.0:1788581211.359143:0:5878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581211.359184:0:5878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70f9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d93bb expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581211.359296:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70fa6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581211.359324:0:5878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581211.359336:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581211.359374:0:5878:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788581211.359378:0:5878:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788581211.359398:0:5878:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581211.359421:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22800/0xf54e3944c2a70f9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d93bb expref: 7 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581211.359452:0:5878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d93bb expref: 6 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581211.359461:0:5878:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c6f1000) 00010000:00010000:0.0:1788581211.359464:0:5878:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581211.359468:0:5878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22600, rc 0) 00000100:00100000:0.0:1788581211.359532:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:12117:x1875462995415296:12345-192.168.201.13@tcp:101:lsof.0 Request processed in 414us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581211.359552:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 239 00000001:00080000:1.0:1788581211.808378:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788581211.808395:0:5899:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788581211.808468:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788581211.808480:0:5911:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788581212.207577:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788581212.272469:0:11735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788581212.272477:0:11735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788581212.272836:0:11735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:1.0:1788581212.272842:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788581213.232705:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581213.298795:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581213.298825:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014273664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581213.298901:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581213.299312:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014273664 00000100:00100000:1.0:1788581213.299320:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014273664 00000100:00100000:1.0:1788581213.299396:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788581213.299407:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014273664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581213.299456:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581213.299532:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014273664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581213.299540:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788581213.299636:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014273664:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788581213.300125:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788581214.255553:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581215.285421:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788581215.741056:0:12820:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 00:06:53 (1788581213) 00000100:00100000:2.0:1788581215.856212:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919047c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014274176:0@lo:400:kworker.0 00000100:00100000:2.0:1788581215.856298:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581215.856357:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581215.856364:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919047c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014274048:0@lo:400:kworker.0 00000100:00100000:2.0:1788581215.856405:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581215.856438:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014274176 00000100:00100000:2.0:1788581215.856448:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014274176 00000100:00100000:2.0:1788581215.856516:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788581215.856526:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014274176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581215.856578:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014274176:12345-0@lo:400:kworker.0 Request processed in 53us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581215.856585:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1788581215.856606:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581215.856640:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919047c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014274176:0@lo:400:kworker.0 00000100:00100000:3.0:1788581215.856720:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919047c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014273920:0@lo:400:kworker.0 00000100:00100000:3.0:1788581215.856753:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581215.856779:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014274432:0@lo:400:kworker.0 00000100:00100000:3.0:1788581215.856801:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581215.856822:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788581215.856828:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f411ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014273792:0@lo:400:kworker.0 00000100:00100000:3.0:1788581215.856853:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581215.856874:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907f86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3341:1875463014274304:0@lo:400:kworker.0 00000100:00100000:3.0:1788581215.856908:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581215.856934:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014274432 00000100:00100000:3.0:1788581215.856938:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014274432 00000100:00100000:3.0:1788581215.856970:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788581215.856977:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43215c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014274432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581215.857010:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43215c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014274432:12345-0@lo:400:kworker.0 Request processed in 34us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581215.857027:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788581215.857046:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014273792 00000100:00100000:3.0:1788581215.857050:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014273792 00000100:00100000:3.0:1788581215.857075:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788581215.857081:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014273792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581215.857110:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3341:x1875463014273792:12345-0@lo:400:kworker.0 Request processed in 29us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581215.857116:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788581215.857139:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014274048 00000100:00100000:3.0:1788581215.857143:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014274048 00000100:00100000:3.0:1788581215.857166:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014273920 00000100:00100000:3.0:1788581215.857168:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014273920 00000100:00100000:3.0:1788581215.857181:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788581215.857187:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014274048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581215.857220:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014274048:12345-0@lo:400:kworker.0 Request processed in 33us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581215.857226:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788581215.857235:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014274304 00000100:00100000:3.0:1788581215.857238:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014274304 00000100:00100000:3.0:1788581215.857296:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788581215.857302:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014273920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581215.857331:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014273920:12345-0@lo:400:kworker.0 Request processed in 28us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581215.857336:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788581215.857347:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788581215.857353:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3341:x1875463014274304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581215.857387:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3341:x1875463014274304:12345-0@lo:400:kworker.0 Request processed in 35us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581215.857393:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:3.0:1788581215.857416:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581215.857419:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581215.857558:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f411ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3341:1875463014273792:0@lo:400:kworker.0 00000100:00100000:3.0:1788581215.857569:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3341:1875463014274304:0@lo:400:kworker.0 00000100:00100000:3.0:1788581215.857578:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919047c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014273920:0@lo:400:kworker.0 00000100:00100000:3.0:1788581215.857586:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907f86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014274432:0@lo:400:kworker.0 00000100:00100000:3.0:1788581215.857613:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919047c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014274048:0@lo:400:kworker.0 00000100:00100000:1.0:1788581216.138795:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581216.138837:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581216.138871:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581216.138891:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581216.138936:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581216.138962:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995415808 00000100:00100000:1.0:1788581216.138972:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995415808 00000100:00100000:1.0:1788581216.139029:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995415680 00000100:00100000:1.0:1788581216.139031:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995415680 00000100:00100000:1.0:1788581216.139045:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 109 00000100:00100000:1.0:1788581216.139052:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2373:x1875462995415808:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581216.139119:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2373:x1875462995415808:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 68us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581216.139125:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 109 00000100:00100000:1.0:1788581216.139139:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 110 00000100:00100000:1.0:1788581216.139143:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2373:x1875462995415680:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581216.139156:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2373:x1875462995415680:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 13us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581216.139159:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 110 00000100:00100000:3.0:1788581216.139282:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995415552 00000100:00100000:3.0:1788581216.139286:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995415552 00000100:00100000:3.0:1788581216.139307:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995415936 00000100:00100000:3.0:1788581216.139308:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995415936 00000100:00100000:3.0:1788581216.139328:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 182 00000100:00100000:3.0:1788581216.139335:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:2373:x1875462995415552:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581216.139368:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:2373:x1875462995415552:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 34us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581216.139374:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 182 00000100:00100000:3.0:1788581216.139387:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 183 00000100:00100000:3.0:1788581216.139394:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:2373:x1875462995415936:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581216.139411:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:2373:x1875462995415936:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 19us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581216.139422:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 183 00000100:00100000:3.0:1788581216.139438:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995415424 00000100:00100000:3.0:1788581216.139440:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995415424 00000100:00100000:3.0:1788581216.139455:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 309 00000100:00100000:3.0:1788581216.139473:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2373:x1875462995415424:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581216.139498:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2373:x1875462995415424:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 27us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581216.139508:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 309 00000100:00080000:3.0:1788581216.139536:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581216.139540:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581216.139542:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788581216.303992:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581216.375748:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788581216.375779:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014274560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581216.375977:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581216.376111:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014274560 00000100:00100000:2.0:1788581216.376120:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014274560 00000100:00100000:2.0:1788581216.376171:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788581216.376181:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014274560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581216.376217:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581216.383969:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014274560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7781us (7985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581216.383984:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788581216.384546:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014274560:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788581217.327996:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581218.351518:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581218.419200:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581218.419227:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014274688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581218.419335:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581218.419666:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014274688 00000100:00100000:3.0:1788581218.419675:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014274688 00000100:00100000:3.0:1788581218.419748:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788581218.419760:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014274688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581218.419798:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788581218.419851:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014274688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581218.419858:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788581218.419905:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014274688:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788581218.421455:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788581219.375432:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581220.399745:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581220.758389:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581220.758897:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995416192 00000100:00100000:0.0:1788581220.758915:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995416192 00000100:00100000:0.0:1788581220.759081:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 66 00000100:00100000:0.0:1788581220.759095:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+18:12338:x1875462995416192:12345-192.168.201.13@tcp:35:umount.0 00000100:00100000:0.0:1788581220.760157:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:12338:x1875462995416192:12345-192.168.201.13@tcp:35:umount.0 Request processed in 1059us (1783us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788581220.760176:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 66 00000100:00080000:2.0:1788581220.760937:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581220.762982:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581220.763075:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995416448 00000100:00100000:2.0:1788581220.763086:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995416448 00000100:00100000:2.0:1788581220.763154:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 67 00000100:00100000:2.0:1788581220.763168:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+19:12338:x1875462995416448:12345-192.168.201.13@tcp:35:umount.0 00000100:00100000:2.0:1788581220.765752:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+20:12338:x1875462995416448:12345-192.168.201.13@tcp:35:umount.0 Request processed in 2570us (2764us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788581220.765780:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 67 00000100:00100000:1.0:1788581220.768938:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581220.769417:0:5880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995416704 00000100:00100000:2.0:1788581220.769432:0:5880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995416704 00000100:00100000:2.0:1788581220.769506:0:5880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 68 00000100:00100000:2.0:1788581220.769519:0:5880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190673cec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+20:12338:x1875462995416704:12345-192.168.201.13@tcp:35:umount.0 00000100:00100000:2.0:1788581220.769848:0:5880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190673cec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11f1870a-1d9b-4af2-bb25-e81f8742df75+21:12338:x1875462995416704:12345-192.168.201.13@tcp:35:umount.0 Request processed in 331us (926us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788581220.769857:0:5880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 68 00000100:00100000:1.0:1788581220.772196:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581220.772437:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995416960 00000100:00100000:0.0:1788581220.772450:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995416960 00000100:00100000:0.0:1788581220.772523:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 69 00000100:00100000:0.0:1788581220.772535:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190484fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+21:12338:x1875462995416960:12345-192.168.201.13@tcp:35:umount.0 00000100:00100000:0.0:1788581220.772983:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190484fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+22:12338:x1875462995416960:12345-192.168.201.13@tcp:35:umount.0 Request processed in 448us (807us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788581220.772992:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 69 00000100:00100000:3.0:1788581220.781599:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581220.781650:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581220.782623:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581220.783755:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995417344 00000100:00100000:0.0:1788581220.783773:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995417344 00000100:00100000:0.0:1788581220.783877:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 72 00000100:00100000:0.0:1788581220.783889:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2371:x1875462995417344:12345-192.168.201.13@tcp:9:umount.0 00000020:00000080:0.0:1788581220.783929:0:6722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a702f6 00000100:00080000:0.0:1788581220.783942:0:6722:0:(import.c:65:import_set_state_nolock()) ffff919076111800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788581220.783989:0:6722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788581220.784821:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11f1870a-1d9b-4af2-bb25-e81f8742df75+2:2371:x1875462995417344:12345-192.168.201.13@tcp:9:umount.0 Request processed in 929us (2197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.784853:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 72 00010000:00010000:0.0:1788581220.784892:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788581220.786605:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581220.792862:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581220.795734:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581220.795822:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995417856 00000100:00100000:0.0:1788581220.795836:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995417856 00000100:00100000:0.0:1788581220.795913:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 73 00000100:00100000:0.0:1788581220.795925:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+7:2371:x1875462995417856:12345-192.168.201.13@tcp:9:umount.0 00000020:00000080:0.0:1788581220.795966:0:10329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a70557 00000020:00010000:0.0:1788581220.795977:0:10329:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91904999e000: total 0 00000100:00080000:0.0:1788581220.795982:0:10329:0:(import.c:65:import_set_state_nolock()) ffff91904999f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788581220.796028:0:10329:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788581220.796958:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11f1870a-1d9b-4af2-bb25-e81f8742df75+5:2371:x1875462995417856:12345-192.168.201.13@tcp:9:umount.0 Request processed in 1026us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.796969:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 73 00000020:00010000:0.0:1788581220.797026:0:6738:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91904999e000: total 0 00010000:00010000:0.0:1788581220.797053:0:6738:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91904999e000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788581220.797123:0:6738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a708fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91e6 expref: 4 pid: 10329 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.797671:0:6738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eba93fc8/0xf54e3944c2a70f98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d93b4 expref: 3 pid: 6723 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581220.797695:0:6738:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91904999e000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788581220.797712:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581220.797714:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581220.797734:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788581220.797746:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581220.798560:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995417216 00000100:00100000:1.0:1788581220.798573:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995417216 00000100:00100000:1.0:1788581220.798664:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995417088 00000100:00100000:1.0:1788581220.798667:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995417088 00000100:00100000:1.0:1788581220.798684:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995417472 00000100:00100000:1.0:1788581220.798687:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995417472 00000100:00100000:1.0:1788581220.798708:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:1.0:1788581220.798718:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43217800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+15:2375:x1875462995417216:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581220.798736:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581220.798754:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190414b2000/0xf54e3944c2a6ff84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f0e expref: 15 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.798772:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581220.798848:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43217800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+14:2375:x1875462995417216:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 131us (17265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581220.798869:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:1.0:1788581220.798889:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:1.0:1788581220.798896:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f86c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+13:2374:x1875462995417088:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581220.798904:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581220.798914:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91907bb82400/0xf54e3944c2a7001e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f46 expref: 13 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.798924:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581220.798943:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f86c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:2374:x1875462995417088:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 48us (17293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581220.798950:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:1.0:1788581220.798962:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:1.0:1788581220.798969:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b910a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+11:2373:x1875462995417472:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581220.798977:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581220.798986:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190413fec00/0xf54e3944c2a70232 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9011 expref: 11 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.798996:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581220.799014:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b910a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2373:x1875462995417472:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 45us (6168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581220.799020:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:1.0:1788581220.827912:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581220.828050:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995418880 00000100:00100000:0.0:1788581220.828064:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995418880 00000100:00100000:0.0:1788581220.828425:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 240 00000100:00100000:0.0:1788581220.828451:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+22:2371:x1875462995418880:12345-192.168.201.13@tcp:39:umount.0 00000020:00000080:0.0:1788581220.828500:0:5878:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6ff92 00000020:00010000:0.0:1788581220.828522:0:5878:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9190485ec800: total 0 00000100:00080000:0.0:1788581220.828528:0:5878:0:(import.c:65:import_set_state_nolock()) ffff9190485ee800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788581220.828564:0:5878:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1788581220.829057:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11f1870a-1d9b-4af2-bb25-e81f8742df75+21:2371:x1875462995418880:12345-192.168.201.13@tcp:39:umount.0 Request processed in 606us (1158us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788581220.829066:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 240 00000020:00010000:1.0:1788581220.829138:0:5865:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9190485ec800: total 0 00010000:00010000:1.0:1788581220.829210:0:5865:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9190485ec800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788581220.829272:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:1.0:1788581220.829288:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788581220.829296:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce800/0xf54e3944c2a705b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d910d expref: 20 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.829324:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff919052341700) 00010000:00010000:1.0:1788581220.829326:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581220.829331:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7025c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d901f expref: 19 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.829353:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:1.0:1788581220.829355:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788581220.829358:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22e00/0xf54e3944c2a708e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91df expref: 18 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.829371:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:1.0:1788581220.829373:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788581220.829386:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82a00/0xf54e3944c2a70c57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d92db expref: 17 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.832175:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:1.0:1788581220.832185:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788581220.832198:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a70f83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d93ad expref: 16 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.832229:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:1.0:1788581220.832232:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788581220.832236:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf000/0xf54e3944c2a70e79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9367 expref: 15 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.832297:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91905c525600) 00010000:00010000:1.0:1788581220.832301:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788581220.832307:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82200/0xf54e3944c2a70978 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9209 expref: 14 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.832329:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:1.0:1788581220.832332:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788581220.832336:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8e00/0xf54e3944c2a707db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9199 expref: 13 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.832350:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91904995a800) 00010000:00010000:1.0:1788581220.832353:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788581220.832357:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23400/0xf54e3944c2a702cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d903b expref: 12 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.832373:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91904995af00) 00010000:00010000:1.0:1788581220.832375:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581220.832390:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22000/0xf54e3944c2a70278 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9026 expref: 11 pid: 9658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.832408:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919052341600) 00010000:00010000:1.0:1788581220.832411:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581220.832415:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bb82e00/0xf54e3944c2a708bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d91d1 expref: 10 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.832428:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff919052341c00) 00010000:00010000:1.0:1788581220.832430:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788581220.832442:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc23800/0xf54e3944c2a70f59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d939f expref: 9 pid: 12524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.832476:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c6f1000) 00010000:00010000:1.0:1788581220.832479:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581220.832483:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9000/0xf54e3944c2a7095c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9202 expref: 8 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581220.832495:0:5865:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9190485ec800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788581220.832528:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581220.832530:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581220.832533:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581220.976796:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919047c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014275200:0@lo:400:kworker.0 00000100:00100000:2.0:1788581220.976930:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581220.977028:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581220.977036:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014275072:0@lo:400:kworker.0 00000100:00100000:2.0:1788581220.977069:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581220.977299:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190474c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014274816:0@lo:400:kworker.0 00000100:00100000:0.0:1788581220.977345:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581220.977411:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919047c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014275328:0@lo:400:kworker.0 00000100:00100000:0.0:1788581220.977438:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581220.977461:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788581220.977468:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014274944:0@lo:400:kworker.0 00000100:00100000:0.0:1788581220.977492:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581220.977514:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919047c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014275456:0@lo:400:kworker.0 00000100:00100000:0.0:1788581220.977538:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581220.977576:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014274816 00000100:00100000:0.0:1788581220.977587:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014274816 00000100:00100000:0.0:1788581220.977649:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788581220.977660:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014274816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581220.977724:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014274816:12345-0@lo:400:kworker.0 Request processed in 65us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.977742:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788581220.977786:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014275072 00000100:00100000:0.0:1788581220.977790:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014275072 00000100:00100000:0.0:1788581220.977829:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014275328 00000100:00100000:0.0:1788581220.977832:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014275328 00000100:00100000:0.0:1788581220.977853:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014274944 00000100:00100000:0.0:1788581220.977856:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014274944 00000100:00100000:0.0:1788581220.977869:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788581220.977877:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014275072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581220.977924:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014275072:12345-0@lo:400:kworker.0 Request processed in 47us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.977932:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788581220.977948:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788581220.977955:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014275328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581220.977992:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014275328:12345-0@lo:400:kworker.0 Request processed in 38us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.977999:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788581220.978020:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788581220.978022:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014275200 00000100:00100000:0.0:1788581220.978032:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014274944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581220.978040:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014275200 00000100:00100000:0.0:1788581220.978074:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014274944:12345-0@lo:400:kworker.0 Request processed in 45us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.978083:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:0.0:1788581220.978120:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788581220.978127:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581220.978135:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014275456 00000100:00100000:3.0:1788581220.978141:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014275456 00000100:00100000:0.0:1788581220.978152:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788581220.978168:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014275200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581220.978185:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788581220.978202:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014275456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581220.978294:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014275200:12345-0@lo:400:kworker.0 Request processed in 131us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.978304:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1788581220.978328:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581220.978367:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014275456:12345-0@lo:400:kworker.0 Request processed in 170us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581220.978373:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919075b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014274944:0@lo:400:kworker.0 00000100:00100000:3.0:1788581220.978394:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788581220.978418:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919047c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014275456:0@lo:400:kworker.0 00000100:00100000:0.0:1788581220.978434:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190474c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014274816:0@lo:400:kworker.0 00000100:00100000:0.0:1788581220.978447:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919047c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014275328:0@lo:400:kworker.0 00000100:00100000:0.0:1788581220.978547:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014275072:0@lo:400:kworker.0 00000100:00100000:0.0:1788581220.978567:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919047c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014275200:0@lo:400:kworker.0 00000100:00100000:1.0:1788581221.251904:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581221.252733:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995419008 00000100:00100000:0.0:1788581221.252751:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995419008 00000100:00100000:0.0:1788581221.252941:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 187 00000100:00100000:0.0:1788581221.252954:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:2372:x1875462995419008:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581221.253186:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:2372:x1875462995419008:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 234us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581221.253195:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 187 00000100:00080000:2.0:1788581221.253751:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788581221.424753:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581221.487845:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581221.487873:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014275584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581221.487959:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581221.488093:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014275584 00000100:00100000:3.0:1788581221.488101:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014275584 00000100:00100000:3.0:1788581221.488166:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788581221.488178:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014275584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581221.488225:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788581221.488325:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014275584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581221.488334:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788581221.488465:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014275584:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788581222.102701:0:5899:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 11f1870a-1d9b-4af2-bb25-e81f8742df75 00000001:00080000:1.0:1788581222.102724:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1788581222.102759:0:5899:0:(genops.c:885:class_export_put()) final put ffff9190485ec800/11f1870a-1d9b-4af2-bb25-e81f8742df75 00000020:00000080:1.0:1788581222.102914:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff9190485ec800/11f1870a-1d9b-4af2-bb25-e81f8742df75 for lustre-MDT0000 00000020:00000080:1.0:1788581222.103051:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9190485ee800 for lustre-MDT0000 00000001:00100000:2.0:1788581222.111831:0:7696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11f1870a-1d9b-4af2-bb25-e81f8742df75 00000020:00000080:2.0:1788581222.111845:0:7696:0:(genops.c:885:class_export_put()) final put ffff919076114800/11f1870a-1d9b-4af2-bb25-e81f8742df75 00000020:00000080:3.0:1788581222.113398:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff919076114800/11f1870a-1d9b-4af2-bb25-e81f8742df75 for lustre-OST0001 00000020:00000080:3.0:1788581222.113483:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff919076111800 for lustre-OST0001 00010000:00010000:0.0:1788581222.448015:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788581222.511628:0:11735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788581222.511644:0:11735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788581222.512035:0:11735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788581222.512043:0:11735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:2.0:1788581222.603114:0:6750:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11f1870a-1d9b-4af2-bb25-e81f8742df75 00000020:00000080:2.0:1788581222.603128:0:6750:0:(genops.c:885:class_export_put()) final put ffff91904999e000/11f1870a-1d9b-4af2-bb25-e81f8742df75 00000020:00000080:1.0:1788581222.605397:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff91904999e000/11f1870a-1d9b-4af2-bb25-e81f8742df75 for lustre-OST0000 00000020:00000080:1.0:1788581222.609616:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91904999f000 for lustre-OST0000 00000100:00100000:2.0:1788581223.025379:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581223.025431:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581223.025470:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995419136 00000100:00100000:2.0:1788581223.025474:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581223.025484:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995419136 00000100:00100000:1.0:1788581223.025622:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995419392 00000100:00100000:1.0:1788581223.025627:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995419392 00000100:00100000:2.0:1788581223.031073:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995419264 00000100:00100000:2.0:1788581223.031120:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995419264 00000100:00100000:2.0:1788581223.031225:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:1.0:1788581223.031473:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:1.0:1788581223.031487:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:2373:x1875462995419392:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581223.031519:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581223.031547:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919044ca8a00/0xf54e3944c2a7021d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d900a expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581223.031573:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581223.031815:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+12:2373:x1875462995419136:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581223.031830:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581223.031842:0:6739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91907bc23c00/0xf54e3944c2a70064 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f5b expref: 11 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581223.031853:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581223.031941:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+10:2373:x1875462995419136:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 705us (6588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581223.031949:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:2.0:1788581223.031978:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00100000:2.0:1788581223.031986:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+9:2373:x1875462995419264:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581223.031994:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581223.032003:0:6739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91907bc22c00/0xf54e3944c2a7006b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f85 expref: 9 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581223.032012:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581223.032027:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+8:2373:x1875462995419264:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 43us (6553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581223.032034:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00100000:1.0:1788581223.033138:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+7:2373:x1875462995419392:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 1645us (7696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581223.033151:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:2.0:1788581223.044949:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581223.045429:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995419648 00000100:00100000:0.0:1788581223.045463:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995419648 00000100:00100000:0.0:1788581223.045570:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 241 00000100:00100000:0.0:1788581223.045583:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+6:2371:x1875462995419648:12345-192.168.201.13@tcp:39:umount.0 00000020:00000080:0.0:1788581223.045645:0:5878:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a70079 00000020:00010000:0.0:1788581223.045655:0:5878:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9190779b2800: total 0 00000100:00080000:0.0:1788581223.045661:0:5878:0:(import.c:65:import_set_state_nolock()) ffff9190779b6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788581223.045700:0:5878:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1788581223.045820:0:5865:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9190779b2800: total 0 00010000:00010000:1.0:1788581223.045826:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581223.045881:0:5865:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9190779b2800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788581223.045927:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905c6f1000) 00010000:00010000:1.0:1788581223.045931:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788581223.045941:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91907bc22600/0xf54e3944c2a70fa6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d93bb expref: 5 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581223.045973:0:5865:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9190779b2800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788581223.045983:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581223.045985:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581223.045987:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581223.046231:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0cbb0a85-7fe6-4f80-9c92-71853a6f2376+3:2371:x1875462995419648:12345-192.168.201.13@tcp:39:umount.0 Request processed in 651us (1297us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788581223.046240:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 241 00000100:00080000:2.0:1788581223.046586:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581223.064519:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581223.069053:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995419904 00000100:00100000:3.0:1788581223.069142:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995419904 00000100:00100000:3.0:1788581223.070008:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 311 00000100:00100000:3.0:1788581223.070029:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904763ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+7:2371:x1875462995419904:12345-192.168.201.13@tcp:251:umount.0 00000020:00000080:3.0:1788581223.070101:0:5871:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6ff6f 00000020:00010000:3.0:1788581223.070129:0:5871:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91907f901000: total 0 00000100:00080000:3.0:1788581223.070135:0:5871:0:(import.c:65:import_set_state_nolock()) ffff91907f900800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788581223.070266:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904763ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de69dcf2-c51b-4af8-b9fa-cef1f40146a6+3:2371:x1875462995419904:12345-192.168.201.13@tcp:251:umount.0 Request processed in 224us (5743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581223.070275:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 311 00000020:00010000:1.0:1788581223.070496:0:5864:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91907f901000: total 0 00010000:00010000:1.0:1788581223.070559:0:5864:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91907f901000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788581223.070610:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919044ca8c00/0xf54e3944c2a70025 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d8f4d expref: 2 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581223.070634:0:5864:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91907f901000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788581223.070645:0:5864:0:(genops.c:885:class_export_put()) final put ffff91907f901000/de69dcf2-c51b-4af8-b9fa-cef1f40146a6 00010000:00010000:1.0:1788581223.070838:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581223.070851:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581223.070853:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788581223.073859:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff91907f901000/de69dcf2-c51b-4af8-b9fa-cef1f40146a6 for MGS 00000020:00000080:2.0:1788581223.073939:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91907f900800 for MGS 00010000:00010000:0.0:1788581223.473494:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581223.535756:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581223.535795:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014275712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581223.535903:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581223.536210:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014275712 00000100:00100000:0.0:1788581223.536224:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014275712 00000100:00100000:0.0:1788581223.536388:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788581223.536401:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f411ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014275712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581223.536453:0:6726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581223.536543:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f411ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014275712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581223.536550:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788581223.538062:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581223.538179:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014275712:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788581224.501432:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788581225.304976:0:13020:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788581225.331382:0:13020:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788581225.331436:0:13020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fffb expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581225.331453:0:13020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fffb expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581225.331461:0:13020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a6fffb expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581225.331468:0:13020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a6fffb expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581225.331489:0:13020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788581225.331495:0:13020:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788581225.331517:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788581225.331522:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788581225.331527:0:13020:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788581225.331552:0:13020:0:(import.c:65:import_set_state_nolock()) ffff91906c6e5800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788581225.331644:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3337:1875463014275840:0@lo:39:umount.0 00000100:00100000:2.0:1788581225.331738:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581225.331896:0:12524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014275840 00000100:00100000:1.0:1788581225.331904:0:12524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014275840 00000100:00100000:1.0:1788581225.331952:0:12524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788581225.331961:0:12524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3337:x1875463014275840:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788581225.331986:0:12524:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fd8c 00000100:00080000:1.0:1788581225.331994:0:12524:0:(import.c:65:import_set_state_nolock()) ffff919075ecc800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788581225.332062:0:12524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3337:x1875463014275840:12345-0@lo:39:umount.0 Request processed in 102us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581225.332080:0:12524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1788581225.332092:0:12524:0:(genops.c:885:class_export_put()) final put ffff919075ecd000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788581225.332167:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581225.332174:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a6fffb expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581225.332183:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b3a00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:0.0:1788581225.332187:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a6fffb expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581225.332207:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf54e3944c2a6fffb expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581225.332215:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf54e3944c2a6fffb expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581225.332221:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788581225.332223:0:5864:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788581225.332226:0:5864:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788581225.332288:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a6fffb expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581225.332295:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581225.332334:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a6fffb expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581225.332341:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff9190414b3a00/0xf54e3944c2a6fff4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a6fffb expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581225.332353:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581225.332355:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581225.332357:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788581225.332368:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff919075ecd000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788581225.332413:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff919075ecc800 for lustre-MDT0000 00000100:00100000:1.0:1788581225.332487:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014275968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581225.332523:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581225.332635:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581225.332647:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014275968 00000100:00100000:2.0:1788581225.332651:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014275968 00000100:00100000:2.0:1788581225.332694:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788581225.332702:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3340:x1875463014275968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581225.332813:0:6739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581225.332830:0:6739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91907bb82800/0xf54e3944c2a6fffb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf54e3944c2a6fff4 expref: 19 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.332840:0:6739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581225.332876:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:3340:x1875463014275968:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581225.332882:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788581225.332941:0:3337:0:(import.c:65:import_set_state_nolock()) ffff91906c6e5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788581225.332962:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3337:1875463014275840:0@lo:39:umount.0 00000100:00100000:1.0:1788581225.333018:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014275968:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788581225.333082:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788581225.333087:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788581225.333091:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788581225.336391:0:13020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70009 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336411:0:13020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a70009 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336419:0:13020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a70009 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336425:0:13020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a70009 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336469:0:13020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581225.336476:0:13020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ff30 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336484:0:13020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6ff30 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336490:0:13020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a6ff30 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336496:0:13020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a6ff30 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336511:0:13020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788581225.336522:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788581225.336528:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a70009 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336535:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb82c00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:2.0:1788581225.336538:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a70009 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336547:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf54e3944c2a70009 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581225.336555:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf54e3944c2a70009 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581225.336560:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788581225.336570:0:5864:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788581225.336604:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a70009 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336611:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581225.336630:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a70009 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336638:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91907bb82c00/0xf54e3944c2a70002 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a70009 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336650:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581225.336653:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a6ff30 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336659:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040030400 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:2.0:1788581225.336662:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a6ff30 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336668:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf54e3944c2a6ff30 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581225.336675:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf54e3944c2a6ff30 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581225.336680:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788581225.336682:0:5864:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788581225.336684:0:5864:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788581225.336697:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a6ff30 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336703:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581225.336843:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a6ff30 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336851:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919040030400/0xf54e3944c2a6ff29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a6ff30 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336866:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581225.336868:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581225.336870:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581225.336883:0:13020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7022b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336891:0:13020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a7022b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336898:0:13020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a7022b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336905:0:13020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a7022b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336919:0:13020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581225.336926:0:6738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581225.336931:0:6738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a7022b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336937:0:6738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23000 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:2.0:1788581225.336940:0:6738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a7022b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336948:0:6738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf54e3944c2a7022b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581225.336961:0:6738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf54e3944c2a7022b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581225.336966:0:6738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788581225.336969:0:6738:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788581225.336971:0:6738:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788581225.336985:0:6738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a7022b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.336991:0:6738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581225.336997:0:6738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a7022b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.337004:0:6738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91907bc23000/0xf54e3944c2a70224 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a7022b expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.337013:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581225.337014:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581225.337016:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581225.337027:0:13020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a6fcdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6fce4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.337035:0:13020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a6fcdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6fce4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.337041:0:13020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a6fcdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a6fce4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.337047:0:13020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a6fcdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a6fce4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.337069:0:13020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788581225.337073:0:13020:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788581225.337075:0:13020:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788581225.337103:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581225.337107:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a6fcdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a6fce4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.337113:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce200 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:2.0:1788581225.337116:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a6fcdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a6fce4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.337122:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a6fcdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf54e3944c2a6fce4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581225.337129:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a6fcdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf54e3944c2a6fce4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581225.337134:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788581225.337136:0:5864:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788581225.337138:0:5864:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788581225.337152:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a6fcdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a6fce4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.337158:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581225.337163:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a6fcdd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a6fce4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.337169:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a6fcdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a6fce4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581225.337189:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581225.337190:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581225.337192:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788581225.337204:0:13020:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788581225.337208:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788581225.337212:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581225.337217:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1788581225.337223:0:13020:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff919075eca000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788581225.337229:0:13020:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff91907f8f4800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788581225.337237:0:13020:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9190779b2800 0cbb0a85-7fe6-4f80-9c92-71853a6f2376 192.168.201.13@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788581225.337262:0:13020:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff919047c9b370) has exports, disconnecting them 00000020:00080000:2.0:1788581225.337267:0:13020:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff919075eca000), last request at 1788581220 00000020:00000080:2.0:1788581225.337273:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fef1 00000100:00080000:2.0:1788581225.337288:0:13020:0:(import.c:65:import_set_state_nolock()) ffff919075ecc000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788581225.337333:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788581225.337345:0:13020:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff919075eca000): rc 0 00000020:00000080:2.0:1788581225.337347:0:13020:0:(genops.c:885:class_export_put()) final put ffff919075eca000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788581225.337353:0:13020:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91907f8f4800), last request at 1788581220 00000020:00000080:2.0:1788581225.337356:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fe26 00000100:00080000:2.0:1788581225.337361:0:13020:0:(import.c:65:import_set_state_nolock()) ffff91907f8f3800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788581225.337371:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788581225.337378:0:13020:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91907f8f4800): rc 0 00000020:00000080:2.0:1788581225.337380:0:13020:0:(genops.c:885:class_export_put()) final put ffff91907f8f4800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788581225.337388:0:13020:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb4bbc1c93ae0 00000100:00080000:2.0:1788581225.337407:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788581225.337411:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1788581225.337424:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788581225.337496:0:13020:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788581225.337508:0:13020:0:(import.c:65:import_set_state_nolock()) ffff919048414000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788581225.337520:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788581225.337523:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788581225.337529:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788581225.337599:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014276608:0@lo:9:umount.0 00000100:00100000:2.0:1788581225.337662:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581225.337827:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014276352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581225.337858:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581225.337890:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581225.337896:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014276224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581225.337916:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581225.337942:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014276352 00000100:00100000:1.0:1788581225.337949:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014276352 00000100:00100000:1.0:1788581225.337986:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014276224 00000100:00100000:1.0:1788581225.337988:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014276224 00000100:00100000:1.0:1788581225.338010:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788581225.338017:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+19:3339:x1875463014276352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581225.338029:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581225.338043:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91907bc23200/0xf54e3944c2a7022b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf54e3944c2a70224 expref: 19 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581225.338057:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581225.338091:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+18:3339:x1875463014276352:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581225.338097:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788581225.338114:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788581225.338121:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:3339:x1875463014276224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581225.338136:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581225.338145:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919040030600/0xf54e3944c2a6ff30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf54e3944c2a6ff29 expref: 17 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581225.338156:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581225.338178:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:3339:x1875463014276224:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581225.338184:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:1.0:1788581225.338219:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff919075eca000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788581225.338271:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff91907f8f4800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788581225.338295:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff919075ecc000 for lustre-MDT0000 00000020:00000080:1.0:1788581225.338310:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91907f8f3800 for lustre-MDT0000 00000100:00100000:1.0:1788581225.338328:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014276480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581225.338355:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581225.338380:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581225.338387:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014276096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581225.338406:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581225.338433:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014276480 00000100:00100000:1.0:1788581225.338437:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014276480 00010000:00010000:3.0:1788581225.338444:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581225.338462:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014276096 00000100:00100000:1.0:1788581225.338466:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014276096 00000100:00100000:1.0:1788581225.338501:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788581225.338508:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+17:3340:x1875463014276480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581225.338516:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581225.338525:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190414b2200/0xf54e3944c2a6fce4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf54e3944c2a6fcdd expref: 17 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581225.338536:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581225.338571:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+16:3340:x1875463014276480:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581225.338577:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788581225.338590:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788581225.338595:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+15:3340:x1875463014276096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581225.338603:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581225.338612:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190414b2e00/0xf54e3944c2a70009 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf54e3944c2a70002 expref: 15 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581225.338620:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581225.338639:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:3340:x1875463014276096:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581225.338645:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788581225.338677:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014276224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581225.338685:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014276352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581225.338708:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014276096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581225.340012:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014276480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581225.340171:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014276608 00000100:00100000:2.0:1788581225.340177:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014276608 00000100:00100000:1.0:1788581225.340359:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788581225.340369:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3337:x1875463014276608:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788581225.340406:0:6725:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fe73 00000100:00080000:1.0:1788581225.340417:0:6725:0:(import.c:65:import_set_state_nolock()) ffff91907fbfc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788581225.340464:0:6725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:0.0:1788581225.340756:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788581225.340821:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788581225.340876:0:13020:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788581225.340896:0:13020:0:(import.c:65:import_set_state_nolock()) ffff9190485eb000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788581225.340949:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014276736:0@lo:9:umount.0 00000100:00100000:3.0:1788581225.341013:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581225.341058:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014276736 00000100:00100000:0.0:1788581225.341064:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014276736 00000020:00080000:2.0:1788581225.341100:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff919047c9b370) has no exports 00000100:00100000:0.0:1788581225.341105:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788581225.341113:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3337:x1875463014276736:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788581225.341142:0:6723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6ff5a 00000100:00080000:0.0:1788581225.341147:0:6723:0:(import.c:65:import_set_state_nolock()) ffff91907f907800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788581225.341181:0:6723:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1788581225.341478:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788581225.342317:0:5872:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581225.344511:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3337:x1875463014276736:12345-0@lo:9:umount.0 Request processed in 3387us (3486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581225.344527:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788581225.346350:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3337:x1875463014276608:12345-0@lo:9:umount.0 Request processed in 5973us (8677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581225.346366:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788581225.348376:0:3337:0:(import.c:65:import_set_state_nolock()) ffff9190485eb000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788581225.348397:0:3337:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788581225.348400:0:3337:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788581225.348407:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014276736:0@lo:9:umount.0 00000100:00080000:3.0:1788581225.348425:0:3337:0:(import.c:65:import_set_state_nolock()) ffff919048414000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788581225.350256:0:3337:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788581225.351951:0:3337:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788581225.351966:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014276608:0@lo:9:umount.0 00000020:00080000:2.0:1788581225.368343:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff919047c9b370) has no exports 00000020:00000080:2.0:1788581225.430885:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fd38 00000020:00000080:2.0:1788581225.430901:0:13020:0:(genops.c:885:class_export_put()) final put ffff91906c6c0000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788581225.430973:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788581225.431143:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91906c6c0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788581225.433773:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788581225.433792:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788581225.433797:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff919047dc8000) has no exports 00000020:00000080:3.0:1788581225.434226:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fd31 00000020:00000080:3.0:1788581225.434237:0:13020:0:(genops.c:885:class_export_put()) final put ffff919077984000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788581225.434792:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff919077984000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788581225.434868:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788581225.434879:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788581225.434883:0:13020:0:(genops.c:885:class_export_put()) final put ffff919077987000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788581225.434885:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff919077987000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788581225.434895:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1788581225.519419:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581226.097857:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3339:1875463014277120:0@lo:400:kworker.0 00000100:00100000:1.0:1788581226.097929:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581226.097997:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581226.098004:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014276992:0@lo:400:kworker.0 00000100:00100000:1.0:1788581226.098028:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581226.098068:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014277120 00000100:00100000:1.0:1788581226.098076:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014277120 00000100:00100000:1.0:1788581226.098111:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014276992 00000100:00100000:1.0:1788581226.098114:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014276992 00000100:00100000:1.0:1788581226.098129:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788581226.098135:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3339:x1875463014277120:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788581226.098142:0:5877:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788581226.098181:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3339:x1875463014277120:12345-0@lo:400:kworker.0 Request processed in 44us (251us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788581226.098187:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788581226.098216:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788581226.098221:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3339:x1875463014276992:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788581226.098225:0:5877:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788581226.098278:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3339:x1875463014276992:12345-0@lo:400:kworker.0 Request processed in 55us (248us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788581226.098283:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1788581226.098355:0:3339:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788581226.098361:0:3339:0:(import.c:65:import_set_state_nolock()) ffff91907f95a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788581226.098365:0:3339:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788581226.101384:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581226.101414:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014276864:0@lo:400:kworker.0 00000100:00100000:2.0:1788581226.101492:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581226.101560:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014276864 00000100:00100000:2.0:1788581226.101568:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014276864 00000100:00100000:2.0:1788581226.101619:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788581226.101627:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919047638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:3340:x1875463014276864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581226.101679:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919047638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ba618d3-9e87-4bcf-a8a7-2c9428d45189+14:3340:x1875463014276864:12345-0@lo:400:kworker.0 Request processed in 53us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581226.101686:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788581226.101734:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014276864:0@lo:400:kworker.0 00000100:00080000:1.0:1788581226.111336:0:3339:0:(import.c:65:import_set_state_nolock()) ffff91907f95a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788581226.111366:0:3339:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 212 00000100:00080000:1.0:1788581226.111376:0:3339:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91907f95a800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:1.0:1788581226.111415:0:3339:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907b97e680 x1875463014277248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581226.111452:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014276992:0@lo:400:kworker.0 00000100:00080000:1.0:1788581226.111489:0:3339:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788581226.111493:0:3339:0:(import.c:65:import_set_state_nolock()) ffff919077984800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788581226.111497:0:3339:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788581226.111500:0:3339:0:(import.c:65:import_set_state_nolock()) ffff919077984800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788581226.111503:0:3339:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 232 00000100:00080000:1.0:1788581226.111508:0:3339:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff919077984800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:1.0:1788581226.111521:0:3339:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907b97ce00 x1875463014277376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581226.111532:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3339:1875463014277120:0@lo:400:kworker.0 00000100:00100000:3.0:1788581226.111630:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3337:1875463014277248:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788581226.111692:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581226.111740:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3337:1875463014277376:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788581226.111760:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581226.111841:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014277248 00000100:00100000:0.0:1788581226.111848:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014277248 00000100:00100000:0.0:1788581226.111885:0:9658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014277376 00000100:00100000:0.0:1788581226.111888:0:9658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014277376 00000100:00100000:0.0:1788581226.111913:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788581226.111921:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3337:x1875463014277248:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788581226.111937:0:9658:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788581226.114930:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3337:x1875463014277248:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 2999us (3228us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788581226.114943:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788581226.114976:0:9658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788581226.114983:0:9658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3337:x1875463014277376:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788581226.114998:0:9658:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788581226.115028:0:9658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3337:x1875463014277376:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 44us (3267us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788581226.115034:0:9658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1788581226.116708:0:3337:0:(import.c:65:import_set_state_nolock()) ffff91907f95a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581226.116719:0:3337:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788581226.116724:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3337:1875463014277248:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788581226.116735:0:3337:0:(import.c:65:import_set_state_nolock()) ffff919077984800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581226.116739:0:3337:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788581226.116742:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3337:1875463014277376:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1788581226.544004:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788581227.223170:0:5899:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0cbb0a85-7fe6-4f80-9c92-71853a6f2376 00000001:00080000:1.0:1788581227.223194:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788581227.223201:0:5899:0:(genops.c:885:class_export_put()) final put ffff9190779b2800/0cbb0a85-7fe6-4f80-9c92-71853a6f2376 00000020:00000080:0.0:1788581227.223306:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9190779b2800/0cbb0a85-7fe6-4f80-9c92-71853a6f2376 for lustre-MDT0000 00000020:00000080:0.0:1788581227.223382:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9190779b6000 for lustre-MDT0000 00000001:00100000:0.0:1788581227.233954:0:7696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788581227.233968:0:7696:0:(genops.c:885:class_export_put()) final put ffff91907f901800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788581227.234577:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff91907f901800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788581227.234649:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91907f907800 for lustre-OST0001 00000020:01000000:3.0:1788581227.439442:0:13020:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91907ba15420 - data ffff919069ba96c0/ffff91907f7e9c00 00000020:01000000:3.0:1788581227.439619:0:13020:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9190480c00c0 - data ffff919058b2aca8/ffff919046bbe000 00000001:00000004:3.0:1788581227.452918:0:13020:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:2.0:1788581227.567736:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788581227.584435:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788581227.584466:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1788581227.584616:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788581227.584620:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788581227.585468:0:6820:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788581227.585475:0:6820:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1788581227.585488:0:6820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788581227.586670:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788581227.586678:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1788581227.586700:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788581227.586711:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788581227.587039:0:8143:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788581227.587045:0:8143:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788581227.587054:0:8143:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788581227.670717:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fd00 00000020:00000080:1.0:1788581227.671116:0:13020:0:(genops.c:885:class_export_put()) final put ffff919076dd7000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788581227.671854:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff919076dd7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788581227.675211:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fd15 00000020:00000080:0.0:1788581227.675489:0:13020:0:(genops.c:885:class_export_put()) final put ffff919076dd4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788581227.675514:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788581227.675533:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788581227.675552:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788581227.675559:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff919047c999b8) has no exports 00000004:01000000:0.0:1788581227.676544:0:13020:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788581227.676560:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6ff53 00000020:00000080:0.0:1788581227.676568:0:13020:0:(genops.c:885:class_export_put()) final put ffff9190485ef800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788581227.676577:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788581227.676583:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788581227.676656:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788581227.676661:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9190762119b8) has no exports 00000020:00000080:0.0:1788581227.676671:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6ff4c 00000020:00000080:0.0:1788581227.676676:0:13020:0:(genops.c:885:class_export_put()) final put ffff9190485e8000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788581227.677345:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff919076dd4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788581227.677380:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9190485ef800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788581227.677384:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9190485e8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788581227.677940:0:13020:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788581227.677947:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788581227.677952:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788581227.677960:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788581227.677964:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788581227.678011:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581227.678023:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788581227.678031:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fe6c 00000020:00000080:0.0:1788581227.678039:0:13020:0:(genops.c:885:class_export_put()) final put ffff91907f8f0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788581227.678050:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788581227.678054:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788581227.678058:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788581227.678061:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff919076214d28) has no exports 00000020:00000080:0.0:1788581227.678067:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fe65 00000020:00000080:0.0:1788581227.678070:0:13020:0:(genops.c:885:class_export_put()) final put ffff919048412000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788581227.678159:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9190485eb000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788581227.678168:0:38:0:(genops.c:885:class_export_put()) final put ffff91907bb55000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788581227.678170:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91907bb55000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788581227.678175:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788581227.678290:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91907f8f0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788581227.678295:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff919048412000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788581227.678805:0:13020:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788581227.678809:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788581227.678812:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788581227.678816:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788581227.678818:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788581227.678894:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581227.678901:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788581227.678932:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581227.678935:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788581227.678939:0:13020:0:(genops.c:885:class_export_put()) final put ffff919048c93000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788581227.678942:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff919048c93000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788581227.678953:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788581227.679126:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fd1c 00000020:00000080:0.0:1788581227.679133:0:13020:0:(genops.c:885:class_export_put()) final put ffff919076dd1800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788581227.679161:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff919048414000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788581227.679168:0:38:0:(genops.c:885:class_export_put()) final put ffff919050d07000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788581227.679171:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff919050d07000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788581227.679183:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788581227.679701:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788581227.679707:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788581227.679714:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788581227.679717:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff919047c9cd28) has no exports 00000020:00000080:0.0:1788581227.679746:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581227.679750:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788581227.679755:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fd23 00000020:00000080:0.0:1788581227.679760:0:13020:0:(genops.c:885:class_export_put()) final put ffff919076dd7800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788581227.679770:0:13020:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91904733b800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788581227.679774:0:13020:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91904733b800 3 00000020:01000004:0.0:1788581227.679778:0:13020:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91904733b800 from lustre-MDT0000 00000020:00000080:0.0:1788581227.679799:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581227.679813:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788581227.679816:0:13020:0:(genops.c:885:class_export_put()) final put ffff919076dd3800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788581227.679818:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff919076dd3800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788581227.679825:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788581227.679858:0:13020:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788581227.679862:0:13020:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788581227.679865:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788581227.679867:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788581227.679869:0:13020:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788581227.679878:0:13020:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff91904733f800 9ba618d3-9e87-4bcf-a8a7-2c9428d45189 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788581227.679883:0:13020:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff919047dcb370) has exports, disconnecting them 00000020:00080000:0.0:1788581227.679888:0:13020:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff91904733f800), last request at 1788580976 00000020:00000080:0.0:1788581227.679909:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fcc1 00000020:00010000:0.0:1788581227.679914:0:13020:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91904733f800: total 2 00000100:00080000:0.0:1788581227.679919:0:13020:0:(import.c:65:import_set_state_nolock()) ffff91904649e800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788581227.679942:0:13020:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91904733f800): rc 0 00000020:00080000:0.0:1788581227.679948:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff919047dcb370) has no exports 00000100:00100000:0.0:1788581227.680014:0:5871:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9190485cde00:5871] 2 exiting: rc = 0 00000100:00100000:0.0:1788581227.680170:0:5870:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff919048cae200:5870] 1 exiting: rc = 0 00000100:00100000:0.0:1788581227.680501:0:5869:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff919047ce7600:5869] 0 exiting: rc = 1 00000100:00100000:0.0:1788581227.680590:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680677:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680685:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680691:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680697:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680705:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680711:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680718:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680725:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680734:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680741:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680747:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680766:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680773:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680780:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680787:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680794:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680800:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680806:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680813:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680820:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680827:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680834:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680840:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680846:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680853:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680859:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680865:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680871:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680878:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680887:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680894:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680901:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680907:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680914:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680921:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680927:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680933:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680939:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680944:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680952:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680957:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680964:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680971:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680976:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680983:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.680989:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.681002:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.681008:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.681015:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.681022:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.681028:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.681033:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.681039:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.681046:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.681050:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.681056:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.681063:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.681071:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.681077:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.681083:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.681089:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.681095:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581227.681102:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788581227.681160:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff919076dd1800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788581227.681168:0:38:0:(genops.c:885:class_export_put()) final put ffff919076dd4000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788581227.681171:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff919076dd4000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788581227.681177:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788581227.681459:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff919076dd7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 20000000:01000000:0.0:1788581227.682048:0:13020:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788581227.682053:0:13020:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:1.0:1788581227.683830:0:13020:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9190414b3000/0xf54e3944c2a6fdd9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xf54e3944c2a6fdd2 expref: 9 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581227.683859:0:13020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190414b3000/0xf54e3944c2a6fdd9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xf54e3944c2a6fdd2 expref: 9 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581227.683874:0:13020:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff919040031e00/0xf54e3944c2a6ffc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xf54e3944c2a6ffbc expref: 8 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581227.683880:0:13020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919040031e00/0xf54e3944c2a6ffc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xf54e3944c2a6ffbc expref: 8 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581227.683886:0:13020:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xf54e3944c2a6ffca expref: 7 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581227.683891:0:13020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190414b2a00/0xf54e3944c2a6ffd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xf54e3944c2a6ffca expref: 7 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581227.683896:0:13020:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff91907bb83e00/0xf54e3944c2a6ffdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xf54e3944c2a6ffd8 expref: 6 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581227.683901:0:13020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91907bb83e00/0xf54e3944c2a6ffdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xf54e3944c2a6ffd8 expref: 6 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581227.683914:0:13020:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9190414b3800/0xf54e3944c2a6ffed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xf54e3944c2a6ffe6 expref: 5 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581227.683921:0:13020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190414b3800/0xf54e3944c2a6ffed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xf54e3944c2a6ffe6 expref: 5 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581227.683926:0:13020:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff91907bb82600/0xf54e3944c2a70017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xf54e3944c2a70010 expref: 4 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581227.683931:0:13020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91907bb82600/0xf54e3944c2a70017 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xf54e3944c2a70010 expref: 4 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581227.683938:0:13020:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a70208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xf54e3944c2a70201 expref: 3 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581227.683943:0:13020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a70208 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xf54e3944c2a70201 expref: 3 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581227.683948:0:13020:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9190413fe800/0xf54e3944c2a70216 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xf54e3944c2a7020f expref: 2 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581227.683952:0:13020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190413fe800/0xf54e3944c2a70216 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xf54e3944c2a7020f expref: 2 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1788581227.684599:0:5865:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91904733f800: total 0 00010000:00010000:3.0:1788581227.685036:0:5865:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91904733f800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788581227.685051:0:5865:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91904733f800, canceled 0 locks, left on hash table 0. 00000020:00000080:3.0:1788581227.685058:0:5865:0:(genops.c:885:class_export_put()) final put ffff91904733f800/9ba618d3-9e87-4bcf-a8a7-2c9428d45189 00010000:00010000:3.0:1788581227.685074:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581227.685076:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581227.685084:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788581227.685445:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91904733f800/9ba618d3-9e87-4bcf-a8a7-2c9428d45189 for MGS 00000020:00000080:2.0:1788581227.685489:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91904649e800 for MGS 00000001:00100000:2.0:1788581227.687289:0:6750:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788581227.687298:0:6750:0:(genops.c:885:class_export_put()) final put ffff91907fbfa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788581227.688018:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff91907fbfa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788581227.688145:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91907fbfc000 for lustre-OST0000 00010000:00010000:0.0:1788581228.594488:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581229.617572:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788581229.743446:0:13020:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91907228ea20 - data ffff91907feea000/ffff91907b981800 00000020:01000000:1.0:1788581229.744074:0:13020:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff919050a92c60 - data ffff91904d838bd0/ffff91905c730800 00000020:00000080:1.0:1788581229.745817:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fca5 00000020:00000080:1.0:1788581229.745851:0:13020:0:(genops.c:885:class_export_put()) final put ffff9190468d8000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788581229.745874:0:13020:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91904733b800 from MGS, refs=2 00000020:01000004:1.0:1788581229.745878:0:13020:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91904733b800 2 00000020:01000004:1.0:1788581229.745882:0:13020:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91904733b800 from MGS 00000020:00000080:1.0:1788581229.745927:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581229.745945:0:13020:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788581229.745947:0:13020:0:(genops.c:885:class_export_put()) final put ffff9190468d8800/MGS 00000020:00000080:1.0:1788581229.745950:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff9190468d8800/MGS for MGS 00000020:01000000:1.0:1788581229.745958:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:3.0:1788581229.746190:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff9190468d8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788581229.746427:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788581229.746432:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581229.746440:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788581229.746450:0:13020:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff91906c6e0800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788581229.746457:0:13020:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff919075ed3370) has exports, disconnecting them 00000020:00080000:1.0:1788581229.746463:0:13020:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff91906c6e0800), last request at 1788580977 00000020:00000080:1.0:1788581229.746468:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fd70 00000020:00080000:1.0:1788581229.746477:0:13020:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91906c6e0800): rc 0 00000020:00000080:1.0:1788581229.746483:0:13020:0:(genops.c:885:class_export_put()) final put ffff91906c6e0800/lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788581229.749498:0:13020:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788581229.749511:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788581229.749517:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788581229.749526:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788581229.750837:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff91906c6e0800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788581229.759358:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581229.759377:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788581229.759388:0:13020:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91904733b800 1 00000020:00000080:1.0:1788581229.759398:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fc97 00000020:00000080:1.0:1788581229.759410:0:13020:0:(genops.c:885:class_export_put()) final put ffff9190468df800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788581229.759418:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788581229.759428:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581229.759433:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788581229.759438:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff919047c98000) has no exports 00000020:00000080:3.0:1788581229.759836:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91906c6e5800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788581229.759847:0:474:0:(genops.c:885:class_export_put()) final put ffff919075ba0000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788581229.759850:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff919075ba0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788581229.759858:0:474:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788581229.759945:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff9190468df800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788581229.892296:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788581229.892319:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788581229.892327:0:13020:0:(genops.c:885:class_export_put()) final put ffff91904733d000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788581229.892333:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff91904733d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788581229.892343:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788581229.892553:0:13020:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91904733b000 00000020:01000000:0.0:1788581229.892582:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788581229.892588:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788581229.892594:0:13020:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788581229.892599:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff919046470000) has no exports 00000100:00100000:3.0:1788581229.892722:0:5878:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff919048df8000:5878] 2 exiting: rc = 0 00000100:00100000:0.0:1788581229.892856:0:9658:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff919076cf5200:9658] 3 exiting: rc = 0 00000100:00100000:3.0:1788581229.892865:0:5876:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff919049c03a00:5876] 0 exiting: rc = 1 00000100:00100000:3.0:1788581229.897406:0:12524:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff918f4250b800:12524] 4 exiting: rc = 0 00000100:00100000:1.0:1788581229.897502:0:5877:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff919049c02a00:5877] 1 exiting: rc = 0 00000100:00100000:0.0:1788581229.900540:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.900556:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.900564:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.900595:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.900604:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.900611:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.900621:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.900628:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901026:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901037:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901046:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901053:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901059:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901065:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901072:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901078:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901083:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901090:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901096:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901104:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901111:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901117:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901125:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901132:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901138:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901145:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901152:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901158:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901165:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901171:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901177:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901183:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901189:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901197:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901207:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901214:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.901220:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904733:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904769:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904776:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904784:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904795:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904842:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904851:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904857:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904863:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904869:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904876:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904882:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904902:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904910:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904916:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904922:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904928:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904935:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904941:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904946:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904953:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904960:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904966:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904972:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904977:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904983:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.904989:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.916027:0:5879:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff919049c03600:5879] 0 exiting: rc = 1 00000100:00100000:3.0:1788581229.916210:0:5880:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff919048df8600:5880] 1 exiting: rc = 0 00000100:00100000:0.0:1788581229.916505:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916517:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916526:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916534:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916542:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916550:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916558:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916564:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916572:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916599:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916605:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916613:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916621:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916627:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916634:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916774:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916780:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916785:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916792:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916797:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916802:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916808:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916813:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916819:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916825:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916831:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916837:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916843:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916850:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916856:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916862:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916867:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916874:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916880:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916885:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916891:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916897:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916904:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916910:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916916:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916921:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916927:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916933:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916939:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916955:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916961:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916967:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916974:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916980:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916985:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916992:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.916998:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.917003:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.917009:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.917015:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.917020:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.917026:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.917032:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.917038:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.917044:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.917050:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.917055:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.917061:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.917067:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.918990:0:5881:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff919046ab3000:5881] 0 exiting: rc = 1 00000100:00100000:3.0:1788581229.919133:0:5882:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff919046ab3800:5882] 1 exiting: rc = 0 00000100:00100000:0.0:1788581229.919408:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919417:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919423:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919445:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919453:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919460:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919467:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919474:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919481:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919487:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919494:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919502:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919509:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919516:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919524:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919561:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919570:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919577:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919586:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919593:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919600:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919608:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919615:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919622:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919629:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919761:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919770:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919798:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919808:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919816:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919824:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919830:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919837:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919846:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919855:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919861:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919868:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919874:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919881:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919903:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919911:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919917:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919925:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919933:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919942:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919949:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919957:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919966:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919972:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919978:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.919994:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.920018:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.920027:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.920034:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.920041:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.920049:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.920055:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.920061:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.920068:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.920075:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.920081:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.920088:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.920095:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.920116:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.938217:0:5884:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff919046ab2c00:5884] 1 exiting: rc = 0 00000100:00100000:1.0:1788581229.938446:0:5883:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff919046ab3e00:5883] 0 exiting: rc = 1 00000100:00100000:2.0:1788581229.942795:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942810:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942815:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942821:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942827:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942832:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942838:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942844:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942874:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942879:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942884:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942890:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942896:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942901:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942906:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942911:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942917:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942923:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942929:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942936:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942941:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942947:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942952:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942957:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942963:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942968:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942974:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942979:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942985:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942990:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.942995:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943000:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943006:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943011:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943018:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943024:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943030:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943036:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943042:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943048:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943053:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943059:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943064:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943078:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943083:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943088:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943094:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943099:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943105:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943110:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943116:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943121:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943126:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943132:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943137:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943142:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943148:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943154:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943160:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943165:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943171:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943176:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943183:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943190:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.943771:0:5885:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff919046ab3200:5885] 0 exiting: rc = 1 00000100:00100000:0.0:1788581229.944091:0:5886:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff919046ab2200:5886] 1 exiting: rc = 0 00000100:00100000:2.0:1788581229.944396:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944404:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944410:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944416:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944422:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944428:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944433:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944438:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944444:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944449:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944455:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944461:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944466:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944485:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944492:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944498:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944504:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944509:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944515:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944522:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944528:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944533:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944539:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944544:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944549:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944554:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944561:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944566:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944573:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944578:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944583:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944589:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944595:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944600:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944606:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944611:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944617:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944622:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944628:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944742:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944751:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944757:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944762:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944767:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944773:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944779:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944784:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944789:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944802:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944807:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944813:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944818:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944824:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944830:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944835:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944841:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944847:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944853:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944859:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944865:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944870:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944875:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944881:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.944887:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.945894:0:5887:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff919046ab2800:5887] 0 exiting: rc = 1 00000100:00100000:1.0:1788581229.946060:0:5888:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff91904852c000:5888] 1 exiting: rc = 0 00000100:00100000:2.0:1788581229.946183:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946192:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946198:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946204:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946209:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946214:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946220:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946235:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946392:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946401:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946407:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946412:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946417:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946422:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946427:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946433:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946438:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946443:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946449:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946467:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946472:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946478:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946483:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946488:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946494:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946499:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946506:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946511:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946516:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946522:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946528:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946534:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946539:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946544:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946548:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946553:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946560:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946565:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946571:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946576:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946580:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946585:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946591:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946596:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946602:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946608:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946614:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946620:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946626:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946631:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946759:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946765:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946771:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946776:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946789:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946794:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946799:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946804:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946808:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946814:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946820:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946825:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946830:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.946835:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788581229.948093:0:5889:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff919046ab2a00:5889] 0 exiting: rc = 1 00000100:00100000:1.0:1788581229.948430:0:5891:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff919049d6d000:5891] 2 exiting: rc = 0 00000100:00100000:3.0:1788581229.948937:0:5890:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff919049d6ce00:5890] 1 exiting: rc = 0 00000100:00100000:2.0:1788581229.949084:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949119:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949127:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949133:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949140:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949147:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949155:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949161:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949167:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949174:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949181:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949188:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949195:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949202:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949209:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949216:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949233:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949650:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949661:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949668:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949674:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949680:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949687:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949833:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949840:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949877:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949884:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949890:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949896:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949904:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949910:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949916:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949922:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949928:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949934:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949940:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949946:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949953:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949959:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949965:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949972:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949978:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949984:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949990:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.949997:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950003:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950010:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950017:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950024:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950046:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950054:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950061:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950067:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950074:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950080:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950086:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950093:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950099:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950106:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950112:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950126:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950133:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950141:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581229.950149:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788581229.958593:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788581229.958613:0:13020:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788581229.958620:0:13020:0:(genops.c:885:class_export_put()) final put ffff919048c92800/MDS_uuid 00000020:00000080:3.0:1788581229.958626:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff919048c92800/MDS_uuid for MDS 00000020:01000000:3.0:1788581229.958643:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788581229.958906:0:13020:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788581230.645205:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581231.226541:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014277504:0@lo:400:kworker.0 00000400:00000100:3.0:1788581231.226596:0:3340:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875463014277504 offset 0 length 224: 4 00000100:00080000:0.0:1788581231.226666:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788581231.226672:0:474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788581231.226676:0:474:0:(import.c:65:import_set_state_nolock()) ffff91907f95a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788581231.226681:0:474:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 442 00000100:00080000:0.0:1788581231.226685:0:474:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788581231.226692:0:474:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91907f95a800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:0.0:1788581231.226715:0:474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907b910000 x1875463014277632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788581231.226732:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788581231.226735:0:474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788581231.226737:0:474:0:(import.c:65:import_set_state_nolock()) ffff919077984800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788581231.226740:0:474:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 442 00000100:00080000:0.0:1788581231.226757:0:474:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788581231.226761:0:474:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff919077984800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:0.0:1788581231.226776:0:474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907b910e00 x1875463014277760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788581231.226805:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3337:1875463014277632:0@lo:38:kworker.0 00000400:00000100:0.0:1788581231.226829:0:3337:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463014277632 offset 0 length 520: 4 00000100:00100000:0.0:1788581231.226845:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3337:1875463014277760:0@lo:38:kworker.0 00000400:00000100:0.0:1788581231.226860:0:3337:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875463014277760 offset 0 length 520: 4 00010000:00010000:1.0:1788581231.664009:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581232.692142:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788581233.105526:0:13175:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788581233.140059:0:13175:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788581233.140114:0:13175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ffdf expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581233.140129:0:13175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6ffdf expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581233.140137:0:13175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a6ffdf expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581233.140144:0:13175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a6ffdf expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581233.140181:0:13175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788581233.140194:0:13175:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788581233.140218:0:13175:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788581233.140232:0:13175:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91907b910000 x1875463014277632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788581246 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581233.140271:0:13175:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1788581233.140366:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581233.140374:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a6ffdf expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581233.140382:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b3200 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:3.0:1788581233.140386:0:5865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a6ffdf expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581233.140410:0:5865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf54e3944c2a6ffdf expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581233.140417:0:5865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf54e3944c2a6ffdf expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581233.140422:0:5865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788581233.140425:0:5865:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788581233.140428:0:5865:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788581233.140466:0:5865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a6ffdf expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581233.140473:0:5865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581233.140503:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a6ffdf expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581233.140510:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff9190414b3200/0xf54e3944c2a6ffd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a6ffdf expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581233.140522:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581233.140524:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581233.140526:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581233.140539:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581233.140553:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014277888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581233.140629:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581233.140693:0:6739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014277888 00000100:00100000:3.0:1788581233.140701:0:6739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014277888 00000100:00100000:3.0:1788581233.140930:0:6739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788581233.140937:0:6739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3340:x1875463014277888:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788581233.140953:0:6739:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788581233 with bad export cookie 17676128554962058433 00000100:00080000:0.0:1788581233.141696:0:3337:0:(import.c:65:import_set_state_nolock()) ffff91907f95a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788581233.141704:0:3337:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1788581233.141709:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3337:1875463014277632:0@lo:38:kworker.0 00000100:00080000:1.0:1788581233.141935:0:13175:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788581233.141942:0:13175:0:(import.c:65:import_set_state_nolock()) ffff91907f95a800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788581233.141949:0:13175:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788581233.141952:0:13175:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788581233.141956:0:13175:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788581233.145940:0:13175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ffed expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581233.145970:0:13175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6ffed expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581233.145975:0:13175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a6ffed expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581233.145979:0:13175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a6ffed expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581233.146000:0:13175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581233.146006:0:13175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70216 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581233.146009:0:13175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a70216 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581233.146013:0:13175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a70216 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581233.146016:0:13175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a70216 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581233.146062:0:13175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788581233.146065:0:13175:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788581233.146085:0:13175:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788581233.146088:0:13175:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788581233.146092:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581233.146096:0:13175:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788581233.146099:0:13175:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff919075ed4d28) has no exports 00000020:00080000:1.0:1788581233.146129:0:13175:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff919075ed4d28) has no exports 00000020:01000000:1.0:1788581233.147669:0:13175:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff919045784360 - data ffff91907ff5d948/ffff918f425b2800 00000020:01000000:1.0:1788581233.148566:0:13175:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff919047c6d060 - data ffff91904dbaa1b0/ffff91906e642800 00010000:00010000:2.0:1788581233.148908:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788581233.148919:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a6ffed expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581233.148929:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040030e00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:2.0:1788581233.148933:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a6ffed expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581233.148943:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf54e3944c2a6ffed expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581233.148950:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf54e3944c2a6ffed expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581233.148955:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788581233.148957:0:5864:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788581233.148960:0:5864:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788581233.149001:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a6ffed expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581233.149008:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581233.149038:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a6ffed expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581233.149045:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919040030e00/0xf54e3944c2a6ffe6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a6ffed expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581233.149056:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581233.149073:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a70216 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581233.149079:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9600 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:2.0:1788581233.149081:0:5864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a70216 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581233.149089:0:5864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf54e3944c2a70216 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581233.149095:0:5864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf54e3944c2a70216 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581233.149099:0:5864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788581233.149102:0:5864:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788581233.149104:0:5864:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788581233.149119:0:5864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a70216 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581233.149125:0:5864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581233.149131:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a70216 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581233.149138:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919044ca9600/0xf54e3944c2a7020f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf54e3944c2a70216 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581233.149147:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581233.149149:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581233.149150:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581233.149366:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014278144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581233.149441:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581233.149496:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581233.149502:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014278016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581233.149525:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581233.149558:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014278144 00000100:00100000:1.0:1788581233.149565:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014278144 00000100:00100000:1.0:1788581233.149630:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014278016 00000100:00100000:1.0:1788581233.149634:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014278016 00000100:00100000:1.0:1788581233.149646:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788581233.149654:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3339:x1875463014278144:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788581233.149990:0:5862:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788581233 with bad export cookie 17676128554962058433 00010000:00010000:0.0:1788581233.150679:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788581233.150958:0:3339:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.113@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788581233.150963:0:3339:0:(import.c:65:import_set_state_nolock()) ffff9190468dc800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788581233.150980:0:3339:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.113@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1788581233.151020:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3339:x1875463014278144:12345-0@lo:103:ldlm_bl.0 Request processed in 1364us (1577us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788581233.151030:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788581233.151055:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788581233.151060:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049af0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3339:x1875463014278016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788581233.151065:0:5862:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788581233 with bad export cookie 17676128554962058433 00000100:00100000:1.0:1788581233.151102:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049af0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3339:x1875463014278016:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (1576us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788581233.151108:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788581233.156122:0:6739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3340:x1875463014277888:12345-0@lo:103:ldlm_bl.0 Request processed in 15175us (15485us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788581233.156137:0:6739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788581233.156226:0:3340:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.113@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788581233.170729:0:3339:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.113@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788581233.170733:0:3339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788581233.170742:0:3339:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91907b912300 x1875463014277504/t0(0) o400->MGC192.168.201.113@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788581247 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581233.170754:0:3339:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91906c7e0000 x1875463014277888/t0(0) o103->MGC192.168.201.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788581249 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581233.170760:0:3339:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9190768cb480 x1875463014278144/t0(0) o103->MGC192.168.201.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788581249 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581233.170766:0:3339:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9190768ca300 x1875463014278016/t0(0) o103->MGC192.168.201.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788581249 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788581233.170948:0:3339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788581233.170951:0:3339:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788581233.170952:0:3339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788581233.171078:0:3340:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9190468dc800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788581233.171105:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014277504:0@lo:400:kworker.0 00000100:00100000:3.0:1788581233.171137:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3340:1875463014277888:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788581233.171181:0:3339:0:(import.c:65:import_set_state_nolock()) ffff9190468dc800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581233.171453:0:3339:0:(import.c:510:import_select_connection()) MGC192.168.201.113@tcp: connect to NID 0@lo last attempt 192 00000100:00080000:2.0:1788581233.171462:0:3339:0:(import.c:624:import_select_connection()) MGC192.168.201.113@tcp: import ffff9190468dc800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:2.0:1788581233.171493:0:3339:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9190768c8000 x1875463014278272/t0(0) o250->MGC192.168.201.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581233.171533:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014278016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788581233.171537:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3339:1875463014278144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581233.171545:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3337:1875463014278272:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1788581233.171601:0:3337:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875463014278272 offset 0 length 520: 4 00100000:10000000:0.0:1788581233.179027:0:13175:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788581233.203804:0:13175:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fdf5 00000020:00000080:3.0:1788581233.203814:0:13175:0:(genops.c:885:class_export_put()) final put ffff91907f905800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788581233.203838:0:13175:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91906c6c6000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788581233.203842:0:13175:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91906c6c6000 2 00000020:01000004:3.0:1788581233.203845:0:13175:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91906c6c6000 from lustre-OST0000 00000020:00000080:3.0:1788581233.203867:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788581233.203878:0:13175:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788581233.203881:0:13175:0:(genops.c:885:class_export_put()) final put ffff91907f907000/lustre-OST0000_UUID 00000020:00000080:3.0:1788581233.203884:0:13175:0:(genops.c:844:class_export_destroy()) destroying export ffff91907f907000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788581233.203892:0:13175:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788581233.203949:0:13175:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788581233.203954:0:13175:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788581233.203958:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788581233.203963:0:13175:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788581233.203970:0:13175:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff91907f95b000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788581233.203977:0:13175:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff919046a68000) has exports, disconnecting them 00000020:00080000:3.0:1788581233.203981:0:13175:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff91907f95b000), last request at 1788580996 00000020:00000080:3.0:1788581233.203985:0:13175:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fe1f 00000020:00080000:3.0:1788581233.203994:0:13175:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91907f95b000): rc 0 00000020:00000080:3.0:1788581233.204014:0:13175:0:(genops.c:885:class_export_put()) final put ffff91907f95b000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788581233.204329:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91907f905800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788581233.204338:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91907f95b000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788581233.205300:0:13175:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788581233.205307:0:13175:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581233.205311:0:13175:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788581233.205318:0:13175:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788581233.205469:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581233.205475:0:13175:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788581233.205490:0:13175:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91906c6c6000 1 00000020:00000080:2.0:1788581233.205496:0:13175:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fdaf 00000020:00000080:2.0:1788581233.205502:0:13175:0:(genops.c:885:class_export_put()) final put ffff919077982800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788581233.205507:0:13175:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788581233.205511:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581233.205514:0:13175:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788581233.205517:0:13175:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff919047dc99b8) has no exports 00000020:00000080:1.0:1788581233.205964:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91907f95a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788581233.205978:0:38:0:(genops.c:885:class_export_put()) final put ffff91907f95d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788581233.205981:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91907f95d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788581233.205987:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788581233.206061:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff919077982800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788581233.228947:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581233.228963:0:13175:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788581233.228968:0:13175:0:(genops.c:885:class_export_put()) final put ffff91906c6c0800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788581233.228973:0:13175:0:(genops.c:844:class_export_destroy()) destroying export ffff91906c6c0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788581233.228982:0:13175:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788581233.229114:0:13175:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91906c6c7800 00000020:02000400:1.0:1788581233.229156:0:13175:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788581233.711395:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581234.735950:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581235.761613:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788581236.061201:0:13326:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788581236.078766:0:13326:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788581236.078856:0:13326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb83600/0xf54e3944c2a6ffbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ffc3 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.078871:0:13326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb83600/0xf54e3944c2a6ffbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6ffc3 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.078896:0:13326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb83600/0xf54e3944c2a6ffbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a6ffc3 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.078903:0:13326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff91907bb83600/0xf54e3944c2a6ffbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a6ffc3 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.078932:0:13326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788581236.078939:0:13326:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788581236.078965:0:13326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788581236.078979:0:13326:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91907b910e00 x1875463014277760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788581246 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581236.078996:0:13326:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788581236.079030:0:3337:0:(import.c:65:import_set_state_nolock()) ffff919077984800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788581236.079045:0:3337:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00010000:00010000:2.0:1788581236.079105:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581236.079112:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91907bb83600/0xf54e3944c2a6ffbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a6ffc3 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581236.079130:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83600 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:2.0:1788581236.079133:0:5865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91907bb83600/0xf54e3944c2a6ffbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a6ffc3 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581236.079149:0:5865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91907bb83600/0xf54e3944c2a6ffbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf54e3944c2a6ffc3 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581236.079157:0:5865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91907bb83600/0xf54e3944c2a6ffbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf54e3944c2a6ffc3 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581236.079163:0:5865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788581236.079165:0:5865:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788581236.079167:0:5865:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788581236.079181:0:5865:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9190468dc800 00010000:00010000:2.0:1788581236.079184:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91907bb83600/0xf54e3944c2a6ffbc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf54e3944c2a6ffc3 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581236.079191:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91907bb83600/0xf54e3944c2a6ffbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf54e3944c2a6ffc3 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581236.079214:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581236.079216:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581236.079217:0:5865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581236.079240:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3337:1875463014277760:0@lo:38:kworker.0 00000100:00080000:0.0:1788581236.079290:0:13326:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788581236.079296:0:13326:0:(import.c:65:import_set_state_nolock()) ffff919077984800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788581236.079301:0:13326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788581236.079303:0:13326:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788581236.079306:0:13326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788581236.080156:0:13326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb83c00/0xf54e3944c2a6ffca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a6ffd1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.080170:0:13326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb83c00/0xf54e3944c2a6ffca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a6ffd1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.080176:0:13326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb83c00/0xf54e3944c2a6ffca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a6ffd1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.080192:0:13326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff91907bb83c00/0xf54e3944c2a6ffca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a6ffd1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.080214:0:13326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581236.080221:0:13326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb82000/0xf54e3944c2a70201 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70208 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.080227:0:13326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb82000/0xf54e3944c2a70201 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a70208 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.080233:0:13326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bb82000/0xf54e3944c2a70201 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a70208 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.080239:0:13326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.113@tcp lock: ffff91907bb82000/0xf54e3944c2a70201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf54e3944c2a70208 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.080275:0:13326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788581236.080280:0:13326:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788581236.080301:0:13326:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788581236.080307:0:13326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:0.0:1788581236.080322:0:6738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581236.080328:0:6738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91907bb83c00/0xf54e3944c2a6ffca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a6ffd1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.080335:0:6738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb83c00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:0.0:1788581236.080339:0:6738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91907bb83c00/0xf54e3944c2a6ffca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a6ffd1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.080346:0:6738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91907bb83c00/0xf54e3944c2a6ffca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf54e3944c2a6ffd1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581236.080360:0:6738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91907bb83c00/0xf54e3944c2a6ffca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf54e3944c2a6ffd1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581236.080365:0:6738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788581236.080367:0:6738:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788581236.080369:0:6738:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788581236.080378:0:6738:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9190468dc800 00010000:00010000:0.0:1788581236.080381:0:6738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91907bb83c00/0xf54e3944c2a6ffca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf54e3944c2a6ffd1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.080386:0:6738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91907bb83c00/0xf54e3944c2a6ffca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf54e3944c2a6ffd1 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.080398:0:6738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581236.080401:0:6738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91907bb82000/0xf54e3944c2a70201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a70208 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.080407:0:6738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bb82000 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:0.0:1788581236.080410:0:6738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91907bb82000/0xf54e3944c2a70201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf54e3944c2a70208 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.080416:0:6738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91907bb82000/0xf54e3944c2a70201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf54e3944c2a70208 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581236.080423:0:6738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91907bb82000/0xf54e3944c2a70201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf54e3944c2a70208 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581236.080428:0:6738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788581236.080429:0:6738:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788581236.080436:0:6738:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788581236.080441:0:6738:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9190468dc800 00010000:00010000:0.0:1788581236.080444:0:6738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91907bb82000/0xf54e3944c2a70201 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf54e3944c2a70208 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.080451:0:6738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91907bb82000/0xf54e3944c2a70201 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf54e3944c2a70208 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581236.080462:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581236.080464:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581236.080466:0:6738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788581236.080476:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788581236.080483:0:13326:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788581236.080487:0:13326:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff919076210000) has no exports 00000020:00080000:0.0:1788581236.080511:0:13326:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff919076210000) has no exports 00000100:00080000:2.0:1788581236.086270:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9ba618d3-9e87-4bcf-a8a7-2c9428d45189->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788581236.086280:0:474:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9ba618d3-9e87-4bcf-a8a7-2c9428d45189->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788581236.086303:0:5864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788581236.087326:0:13326:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff919049a61780 - data ffff91907feeae58/ffff91907b983400 00000020:01000000:0.0:1788581236.087683:0:13326:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91907228e180 - data ffff91904d93c798/ffff91907bb84800 00100000:10000000:1.0:1788581236.109664:0:13326:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788581236.171340:0:13326:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fec0 00000020:00000080:2.0:1788581236.171351:0:13326:0:(genops.c:885:class_export_put()) final put ffff91907bb55800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788581236.171372:0:13326:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91907f8f1000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788581236.171375:0:13326:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91907f8f1000 2 00000020:01000004:2.0:1788581236.171378:0:13326:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91907f8f1000 from lustre-OST0001 00000020:00000080:2.0:1788581236.171400:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581236.171410:0:13326:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788581236.171412:0:13326:0:(genops.c:885:class_export_put()) final put ffff91907bb57000/lustre-OST0001_UUID 00000020:00000080:2.0:1788581236.171415:0:13326:0:(genops.c:844:class_export_destroy()) destroying export ffff91907bb57000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788581236.171421:0:13326:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788581236.171553:0:13326:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 9ba618d3-9e87-4bcf-a8a7-2c9428d45189->MGS 00010000:00010000:2.0:1788581236.171568:0:13326:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919044ca8200/0xf54e3944c2a6fdd2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf54e3944c2a6fdd9 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581236.171578:0:13326:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919044ca8200/0xf54e3944c2a6fdd2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf54e3944c2a6fdd9 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581236.171584:0:13326:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788581236.171586:0:13326:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788581236.171590:0:13326:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788581236.171604:0:13326:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9190468dc800 00010000:00010000:2.0:1788581236.171608:0:13326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919044ca8200/0xf54e3944c2a6fdd2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf54e3944c2a6fdd9 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581236.171637:0:13326:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919044ca8800/0xf54e3944c2a70010 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf54e3944c2a70017 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581236.171644:0:13326:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919044ca8800/0xf54e3944c2a70010 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf54e3944c2a70017 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581236.171649:0:13326:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788581236.171651:0:13326:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788581236.171653:0:13326:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788581236.171662:0:13326:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9190468dc800 00010000:00010000:2.0:1788581236.171665:0:13326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919044ca8800/0xf54e3944c2a70010 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf54e3944c2a70017 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788581236.171681:0:13326:0:(import.c:65:import_set_state_nolock()) ffff9190468dc800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788581236.171684:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788581236.171687:0:13326:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788581236.171688:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788581236.171692:0:13326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788581236.171703:0:13326:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9190768c8000 x1875463014278272/t0(0) o250->MGC192.168.201.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788581243 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788581236.171723:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788581236.171725:0:13326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:3.0:1788581236.171969:0:12643:0:(genops.c:844:class_export_destroy()) destroying export ffff91907bb55800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1788581236.172064:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9ba618d3-9e87-4bcf-a8a7-2c9428d45189:3337:1875463014278272:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:2.0:1788581236.172154:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788581236.172162:0:13326:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fcb3 00000020:00000080:2.0:1788581236.172167:0:13326:0:(genops.c:885:class_export_put()) final put ffff919048c95800/9ba618d3-9e87-4bcf-a8a7-2c9428d45189 00000020:01000000:2.0:1788581236.172182:0:13326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.113@tcp (flags='') 00000020:00000080:2.0:1788581236.172186:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581236.172192:0:13326:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.113@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788581236.172195:0:13326:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff919047dccd28) has no exports 00000020:00000080:3.0:1788581236.172263:0:12643:0:(genops.c:844:class_export_destroy()) destroying export ffff919048c95800/9ba618d3-9e87-4bcf-a8a7-2c9428d45189 for MGC192.168.201.113@tcp 10000000:01000000:1.0:1788581236.172314:0:5874:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788581236.172449:0:13326:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.113@tcp: client import never connected 00000100:00080000:2.0:1788581236.172458:0:13326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788581236.172460:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788581236.172462:0:13326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788581236.172464:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788581236.172753:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581236.172759:0:13326:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.113@tcp (uuid 9ba618d3-9e87-4bcf-a8a7-2c9428d45189) 00000020:01000000:2.0:1788581236.172764:0:13326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788581236.172768:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581236.172771:0:13326:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788581236.172776:0:13326:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff919046ad6000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788581236.172781:0:13326:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff919046a699b8) has exports, disconnecting them 00000020:00080000:2.0:1788581236.172785:0:13326:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff919046ad6000), last request at 1788581016 00000020:00000080:2.0:1788581236.172789:0:13326:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6feea 00000020:00080000:2.0:1788581236.172799:0:13326:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff919046ad6000): rc 0 00000020:00000080:2.0:1788581236.172803:0:13326:0:(genops.c:885:class_export_put()) final put ffff919046ad6000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788581236.173022:0:12643:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9190468dc800 for MGC192.168.201.113@tcp 00000020:00000080:3.0:1788581236.173029:0:12643:0:(genops.c:885:class_export_put()) final put ffff9190468dd000/9ba618d3-9e87-4bcf-a8a7-2c9428d45189 00000020:00000080:3.0:1788581236.173031:0:12643:0:(genops.c:844:class_export_destroy()) destroying export ffff9190468dd000/9ba618d3-9e87-4bcf-a8a7-2c9428d45189 for MGC192.168.201.113@tcp 00000020:01000000:3.0:1788581236.173036:0:12643:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.113@tcp (9ba618d3-9e87-4bcf-a8a7-2c9428d45189) 00000020:00000080:3.0:1788581236.175601:0:12643:0:(genops.c:844:class_export_destroy()) destroying export ffff919046ad6000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788581236.190849:0:13326:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788581236.190859:0:13326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788581236.190863:0:13326:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788581236.190871:0:13326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788581236.191094:0:5865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1788581236.191363:0:12643:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff919077984800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788581236.191450:0:6738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788581236.191645:0:5864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788581236.191796:0:5859:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff919049b60200:5859] 0 exiting: rc = 1 00000100:00100000:3.0:1788581236.191872:0:5860:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff919047ce7200:5860] 1 exiting: rc = 0 00000100:00100000:2.0:1788581236.192031:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.192442:0:5861:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff919047ce7a00:5861] 0 exiting: rc = 1 00000100:00100000:1.0:1788581236.192509:0:5862:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff919047ce6800:5862] 1 exiting: rc = 0 00000100:00100000:3.0:1788581236.193023:0:5863:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff919047ce6a00:5863] 2 exiting: rc = 0 00000100:00100000:0.0:1788581236.193648:0:6739:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff91906e628000:6739] 3 exiting: rc = 0 00000100:00100000:2.0:1788581236.193863:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193872:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193878:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193884:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193889:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193894:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193899:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193906:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193912:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193918:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193924:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193929:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193949:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193955:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193962:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193968:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193974:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193981:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193986:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193991:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.193997:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194002:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194008:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194014:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194019:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194024:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194029:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194035:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194039:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194044:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194049:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194054:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194060:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194065:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194070:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194076:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194081:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194086:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194091:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194097:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194103:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194109:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194123:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194129:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194398:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194407:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194969:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194990:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.194996:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.195001:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.195006:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.195010:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.195015:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.195019:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.195023:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.195028:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.195034:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.195038:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.195044:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.195049:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.195055:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.195060:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.195066:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.195071:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788581236.196599:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788581236.196611:0:13326:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788581236.196616:0:13326:0:(genops.c:885:class_export_put()) final put ffff919046ad2000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788581236.196621:0:13326:0:(genops.c:844:class_export_destroy()) destroying export ffff919046ad2000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788581236.196627:0:13326:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788581236.196670:0:13326:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91907f8f1000 1 00000020:00000080:1.0:1788581236.196676:0:13326:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf54e3944c2a6fe8f 00000020:00000080:1.0:1788581236.196683:0:13326:0:(genops.c:885:class_export_put()) final put ffff919048413000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788581236.196726:0:13326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788581236.196731:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788581236.196744:0:13326:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788581236.196749:0:13326:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9190464719b8) has no exports 00000020:00000080:3.0:1788581236.201269:0:12643:0:(genops.c:844:class_export_destroy()) destroying export ffff919048413000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788581236.208647:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581236.208662:0:13326:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788581236.208668:0:13326:0:(genops.c:885:class_export_put()) final put ffff91907f8f1800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788581236.208672:0:13326:0:(genops.c:844:class_export_destroy()) destroying export ffff91907f8f1800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788581236.208679:0:13326:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788581236.208875:0:13326:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91907f8f0000 00000020:01000000:2.0:1788581236.208894:0:13326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788581236.208897:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788581236.208901:0:13326:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788581236.208905:0:13326:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff919046a6cd28) has no exports 00000020:00000080:2.0:1788581236.208930:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788581236.208936:0:13326:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788581236.208938:0:13326:0:(genops.c:885:class_export_put()) final put ffff919077982000/OSS_uuid 00000020:00000080:2.0:1788581236.208940:0:13326:0:(genops.c:844:class_export_destroy()) destroying export ffff919077982000/OSS_uuid for OSS 00000020:01000000:2.0:1788581236.208944:0:13326:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1788581236.208966:0:5872:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788581236.209214:0:12526:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff919076cf5e00:12526] 4 exiting: rc = 0 00000100:00100000:1.0:1788581236.209332:0:6725:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff919047cc5a00:6725] 2 exiting: rc = 0 00000100:00100000:1.0:1788581236.209381:0:6722:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff919049c1c600:6722] 0 exiting: rc = 1 00000100:00100000:0.0:1788581236.209494:0:6723:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff919075bedc00:6723] 1 exiting: rc = 0 00000100:00100000:0.0:1788581236.209615:0:10329:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9190721d7600:10329] 3 exiting: rc = 0 00000100:00100000:2.0:1788581236.209803:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209825:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209831:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209837:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209843:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209847:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209853:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209858:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209864:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209869:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209874:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209879:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209885:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209890:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209895:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209900:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209905:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209911:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209915:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209921:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209925:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209930:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209935:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209940:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209946:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209951:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209955:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209959:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209964:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209970:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209974:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209979:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209983:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209989:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.209994:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210000:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210013:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210019:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210024:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210029:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210037:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210042:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210049:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210054:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210059:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210065:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210070:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210075:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210079:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210084:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210090:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210095:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210100:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210105:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210110:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210125:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210131:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210228:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210237:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210272:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210279:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210284:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210290:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.210295:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.211311:0:6727:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff91904554cc00:6727] 1 exiting: rc = 0 00000100:00100000:0.0:1788581236.216380:0:6726:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff91904554de00:6726] 0 exiting: rc = 1 00000100:00100000:1.0:1788581236.218929:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.218939:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.218945:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.218950:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.218956:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.218962:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.218967:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.218973:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.218977:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.218982:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.218987:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.218991:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.218996:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219001:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219006:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219011:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219016:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219021:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219026:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219030:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219034:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219038:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219043:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219048:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219052:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219058:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219062:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219068:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219072:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219089:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219094:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219099:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219106:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219110:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219124:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219130:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219227:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219235:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219263:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219270:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219276:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219281:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219287:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219292:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219298:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219303:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219312:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219318:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219326:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219334:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219339:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219345:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219350:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219355:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219361:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219366:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219371:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219376:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219381:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219386:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219391:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219395:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219400:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.219411:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.220856:0:6729:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff919047cc4e00:6729] 1 exiting: rc = 0 00000100:00100000:2.0:1788581236.221451:0:6730:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff91904554c200:6730] 2 exiting: rc = 0 00000100:00100000:2.0:1788581236.223652:0:6728:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff91904554d200:6728] 0 exiting: rc = 1 00000100:00100000:1.0:1788581236.223799:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223807:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223813:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223819:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223824:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223830:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223844:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223852:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223858:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223863:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223869:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223874:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223880:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223886:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223892:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223898:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223903:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223909:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223918:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223923:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223929:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223934:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223940:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223945:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223951:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223957:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223962:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223968:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223973:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223978:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.223984:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224005:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224012:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224017:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224022:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224044:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224048:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224054:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224060:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224068:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224207:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224215:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224220:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224225:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224230:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224236:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224346:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224355:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224361:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224367:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224372:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224378:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224384:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224389:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224395:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224402:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224424:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224431:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224437:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224442:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224448:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224454:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224461:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788581236.224467:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.232692:0:6732:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff91906e628400:6732] 1 exiting: rc = 0 00000100:00100000:3.0:1788581236.232819:0:6731:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff919050b6a800:6731] 0 exiting: rc = 1 00000100:00100000:2.0:1788581236.232913:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.232920:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.232938:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.232942:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.232947:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.232952:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.232957:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.232962:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.232967:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.232972:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.232976:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.232981:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.232986:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.232991:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.232996:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233001:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233006:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233011:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233016:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233021:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233025:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233031:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233036:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233065:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233072:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233077:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233082:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233086:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233092:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233096:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233102:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233107:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233112:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233128:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233200:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233210:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233215:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233227:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233233:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233238:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233301:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233308:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233313:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233317:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233321:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233326:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233332:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233337:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233342:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233346:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233351:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233355:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233359:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233364:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233368:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233374:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233378:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233382:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233386:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233391:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233396:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233400:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233406:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.233410:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788581236.234434:0:6733:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff91906e629000:6733] 0 exiting: rc = 1 00000100:00100000:2.0:1788581236.234602:0:6734:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff919050b6ae00:6734] 1 exiting: rc = 0 00000100:00100000:2.0:1788581236.234653:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234661:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234667:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234675:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234683:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234689:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234695:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234711:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234717:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234723:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234740:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234748:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234754:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234761:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234767:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234773:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234779:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234784:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234791:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234796:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234802:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234808:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234828:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234837:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234843:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234849:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234855:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234861:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234868:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234874:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234880:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234886:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234893:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234899:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234920:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234928:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234935:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234941:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234947:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234953:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234958:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234964:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234977:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234983:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234989:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.234994:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235016:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235024:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235030:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235037:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235043:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235048:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235054:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235060:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235066:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235072:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235077:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235083:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235102:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235109:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235124:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235131:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235323:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788581236.235330:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788581236.248774:0:13326:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788581257.047870:0:13939:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788581267.337011:0:14399:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788581267.337017:0:14399:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788581267.337146:0:14399:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff919059822800 00000020:01000004:2.0:1788581267.337163:0:14399:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788581267.337172:0:14399:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788581267.337188:0:14399:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9190464719b8) 00000020:00000080:2.0:1788581267.337202:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788581267.371337:0:14399:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788581267.379942:0:14399:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1788581267.381317:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 435: rc = 0 00100000:10000000:1.0:1788581267.381436:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 435: rc = 0 00100000:10000000:1.0:1788581267.383392:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 435: rc = 0 00100000:10000000:1.0:1788581267.383596:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 435: rc = 0 00100000:10000000:1.0:1788581267.383708:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 435: rc = 0 00100000:10000000:1.0:1788581267.384386:0:14399:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788581267.384459:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 435: rc = 0 00100000:10000000:1.0:1788581267.385901:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 437: rc = 0 00100000:10000000:1.0:1788581267.387278:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 578: rc = 0 00100000:10000000:1.0:1788581267.387375:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 578: rc = 0 00100000:10000000:1.0:1788581267.389104:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 773: rc = 0 00100000:10000000:1.0:1788581267.389459:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 773: rc = 0 00100000:10000000:1.0:1788581267.389704:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 773: rc = 0 00100000:10000000:1.0:1788581267.389977:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 773: rc = 0 00100000:10000000:1.0:1788581267.390194:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 773: rc = 0 00100000:10000000:1.0:1788581267.390445:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 773: rc = 0 00100000:10000000:1.0:1788581267.392150:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 773: rc = 0 00100000:10000000:1.0:1788581267.395858:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 773: rc = 0 00100000:10000000:1.0:1788581267.396299:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1788581267.398848:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1788581267.399142:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 773: rc = 0 00100000:10000000:2.0:1788581267.400100:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1788581267.402143:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 653: rc = 0 00100000:10000000:3.0:1788581267.404944:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 653: rc = 0 00100000:10000000:3.0:1788581267.405192:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 653: rc = 0 00100000:10000000:3.0:1788581267.405441:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 653: rc = 0 00100000:10000000:3.0:1788581267.405982:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 653: rc = 0 00100000:10000000:3.0:1788581267.406198:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 653: rc = 0 00100000:10000000:3.0:1788581267.406770:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 653: rc = 0 00100000:10000000:3.0:1788581267.407177:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 653: rc = 0 00100000:10000000:3.0:1788581267.407438:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 653: rc = 0 00100000:10000000:3.0:1788581267.408595:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 653: rc = 0 00100000:10000000:3.0:1788581267.409395:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 653: rc = 0 00100000:10000000:3.0:1788581267.409753:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 653: rc = 0 00100000:10000000:3.0:1788581267.410026:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 653: rc = 0 00100000:10000000:3.0:1788581267.410433:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 653: rc = 0 00100000:10000000:3.0:1788581267.410758:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 653: rc = 0 00100000:10000000:3.0:1788581267.411391:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 653: rc = 0 00100000:10000000:3.0:1788581267.411685:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 653: rc = 0 00100000:10000000:3.0:1788581267.411944:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 653: rc = 0 00100000:10000000:3.0:1788581267.412193:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 653: rc = 0 00100000:10000000:3.0:1788581267.412895:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 653: rc = 0 00100000:10000000:3.0:1788581267.413172:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 653: rc = 0 00100000:10000000:3.0:1788581267.413434:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 653: rc = 0 00100000:10000000:3.0:1788581267.415307:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 653: rc = 0 00100000:10000000:3.0:1788581267.415628:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 653: rc = 0 00100000:10000000:3.0:1788581267.416093:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 653: rc = 0 00100000:10000000:3.0:1788581267.416633:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 653: rc = 0 00100000:10000000:3.0:1788581267.417217:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 653: rc = 0 00100000:10000000:3.0:1788581267.417486:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 653: rc = 0 00100000:10000000:3.0:1788581267.417732:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 653: rc = 0 00100000:10000000:3.0:1788581267.422965:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 653: rc = 0 00100000:10000000:3.0:1788581267.423493:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 653: rc = 0 00100000:10000000:3.0:1788581267.425819:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 653: rc = 0 00100000:10000000:3.0:1788581267.426625:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 650: rc = 0 00100000:10000000:3.0:1788581267.429673:0:14399:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788581267.429853:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:3.0:1788581267.430115:0:14399:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788581267.430174:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:3.0:1788581267.430401:0:14399:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788581267.430459:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:3.0:1788581267.430823:0:14399:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788581267.430881:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 579: rc = 0 00100000:10000000:3.0:1788581267.431408:0:14399:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788581267.431465:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 579: rc = 0 00100000:10000000:3.0:1788581267.431720:0:14399:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788581267.431780:0:14399:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 579: rc = 0 00000020:00000080:3.0:1788581267.432619:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788581267.432629:0:14399:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788581267.432644:0:14399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf54e3944c2a70fb4 00000020:01000004:3.0:1788581267.432652:0:14399:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788581267.432657:0:14399:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788581267.432663:0:14399:0:(tgt_mount.c:101:server_register_mount()) register mount ffff919059822800 from MGS 00000020:01000004:3.0:1788581267.432668:0:14399:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788581267.432681:0:14399:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff919046a6b370) 00000020:00000080:3.0:1788581267.432692:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788581267.432751:0:14399:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919059822800 from MGS, refs=2 00080000:01000000:3.0:1788581267.432755:0:14399:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788581267.432760:0:14399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf54e3944c2a70fc2 00000100:00100000:3.0:1788581267.433152:0:14399:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788581267.433330:0:14399:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788581267.433336:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788581267.435753:0:14399:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788581267.435767:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788581267.436558:0:14399:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788581267.436773:0:14399:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788581267.436779:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788581267.437886:0:14399:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788581267.437898:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788581267.438357:0:14399:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788581267.438365:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788581267.439202:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581267.439206:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581267.439209:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581267.440436:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581267.440439:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581267.440442:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581267.441198:0:14399:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788581267.448194:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788581267.466499:0:14399:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788581267.466521:0:14399:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788581267.466523:0:14399:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788581267.476724:0:14409:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788581267.477271:0:14399:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788581267.477384:0:14399:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788581267.480589:0:14399:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788581267.481123:0:14399:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788581267.481470:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788581267.481477:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788581267.483851:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788581267.483865:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788581267.484201:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788581267.484208:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788581267.485957:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788581267.485986:0:14399:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.113@tcp' 00000020:01000004:0.0:1788581267.485988:0:14399:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788581267.486036:0:14399:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.113@tcp (typ=mgc) 00000020:00000080:0.0:1788581267.486052:0:14399:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.113@tcp (ffff919076213370) 00000020:00000080:0.0:1788581267.486080:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788581267.486155:0:14399:0:(ldlm_lib.c:102:import_set_conn()) imp ffff918f4364d800@MGC192.168.201.113@tcp: add connection 192.168.201.113@tcp at head 00010000:00010000:0.0:1788581267.486334:0:14399:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.113@tcp-0 is initialized 00000040:01000000:0.0:1788581267.486341:0:14399:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.113@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788581267.486800:0:14413:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788581267.488744:0:14414:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788581267.488832:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.113@tcp (uuid 6c4ed75f-0e9f-4624-94e3-96119520d4d4) 00000020:00000080:0.0:1788581267.488854:0:14399:0:(genops.c:1385:class_connect()) connect: client 6c4ed75f-0e9f-4624-94e3-96119520d4d4, cookie 0xf54e3944c2a70fd0 00000100:00080000:0.0:1788581267.488866:0:14399:0:(import.c:510:import_select_connection()) MGC192.168.201.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788581267.488872:0:14399:0:(import.c:624:import_select_connection()) MGC192.168.201.113@tcp: import ffff918f4364d800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:0.0:1788581267.488906:0:14399:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907b910e00 x1875463014278400/t0(0) o250->MGC192.168.201.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788581267.488935:0:14399:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6c4ed75f-0e9f-4624-94e3-96119520d4d4->MGS 00000020:01000004:0.0:1788581267.488960:0:14399:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788581267.488965:0:14399:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788581267.488979:0:14399:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff919076210000) 00000020:00000080:0.0:1788581267.488989:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788581267.493078:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3337:1875463014278400:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788581267.493183:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581267.493323:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014278400 00000100:00100000:1.0:1788581267.493335:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014278400 00000100:00100000:1.0:1788581267.493392:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581267.493401:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f91b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3337:x1875463014278400:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788581267.493429:0:14410:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6c4ed75f-0e9f-4624-94e3-96119520d4d4@0@lo t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:1.0:1788581267.493454:0:14410:0:(genops.c:1385:class_connect()) connect: client 6c4ed75f-0e9f-4624-94e3-96119520d4d4, cookie 0xf54e3944c2a70fde 00000100:00080000:1.0:1788581267.493599:0:14410:0:(import.c:65:import_set_state_nolock()) ffff919068080800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581267.493653:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f91b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+5:3337:x1875463014278400:12345-0@lo:250:mount.lustre.0 Request processed in 252us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581267.493660:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581267.493696:0:3337:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788581267.493705:0:3337:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.113@tcp: connect to target with instance 0 00000100:00080000:1.0:1788581267.493713:0:3337:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788581267.493718:0:3337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788581267.493721:0:3337:0:(import.c:65:import_set_state_nolock()) ffff918f4364d800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788581267.493723:0:3337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788581267.493732:0:3337:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788581267.493737:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3337:1875463014278400:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788581267.510728:0:14399:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788581267.510919:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788581267.510926:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788581267.514452:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788581267.514462:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788581267.514834:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788581267.514840:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788581267.515641:0:14399:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581267.515811:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788581267.515816:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788581267.516577:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788581267.516595:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788581267.563374:0:14399:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581267.563919:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788581267.563926:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788581267.565410:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788581267.565423:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788581267.566224:0:14399:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581267.566452:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788581267.566458:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788581267.567119:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788581267.567126:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788581267.570168:0:14399:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788581267.570389:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788581267.570394:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788581267.571610:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788581267.571628:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788581267.572761:0:14399:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581267.573090:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788581267.573096:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788581267.575895:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788581267.575908:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788581267.596723:0:14399:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581267.596941:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788581267.596947:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788581267.601035:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788581267.601053:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788581267.602047:0:14399:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788581267.602057:0:14399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788581267.603595:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788581267.603620:0:14399:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788581267.603627:0:14399:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788581267.603758:0:14399:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788581267.603850:0:14399:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.113@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788581267.603855:0:14399:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788581267.603856:0:14399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788581267.603858:0:14399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581267.603859:0:14399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581267.603860:0:14399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581267.603862:0:14399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581267.603867:0:14399:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581267.603869:0:14399:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788581267.603870:0:14399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581267.603871:0:14399:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788581267.603874:0:14399:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788581267.603876:0:14399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788581267.603877:0:14399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788581267.603878:0:14399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581267.603879:0:14399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581267.603880:0:14399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581267.603881:0:14399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581267.603882:0:14399:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581267.603883:0:14399:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788581267.603884:0:14399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581267.603884:0:14399:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788581267.603910:0:14399:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788581267.603930:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014278528:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788581267.604006:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581267.604098:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190768b2240 going to sleep for 11 seconds 00000100:00100000:3.0:1788581267.604138:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014278528 00000100:00100000:3.0:1788581267.604145:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014278528 00000100:00100000:3.0:1788581267.604211:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581267.604221:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f919850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+5:14399:x1875463014278528:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788581267.604454:0:14412:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788581267.604457:0:14412:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788581267.604460:0:14412:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788581267.604846:0:14432:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788581267.605568:0:14412:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1788581267.607016:0:14433:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788581267.607026:0:14433:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788581267.607029:0:14433:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788581267.607083:0:14433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788581267.607715:0:14412:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788581267.607725:0:14412:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788581267.614820:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f919850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+5:14399:x1875463014278528:12345-0@lo:253:mount.lustre.0 Request processed in 10592us (10805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581267.614834:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581267.614932:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014278528:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788581267.614947:0:14399:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788581267.614951:0:14399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788581267.614953:0:14399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788581267.614954:0:14399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581267.614956:0:14399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581267.614957:0:14399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581267.614958:0:14399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581267.614960:0:14399:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581267.614962:0:14399:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788581267.614963:0:14399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581267.614965:0:14399:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788581267.614982:0:14399:0:(tgt_mount.c:101:server_register_mount()) register mount ffff919059822800 from lustre-MDT0000 10000000:01000000:2.0:1788581267.615062:0:14399:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788581267.615076:0:14399:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788581267.615080:0:14399:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff919076213370 10000000:01000000:2.0:1788581267.615084:0:14399:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788581267.615091:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff919076213370 from 1 10000000:01000000:2.0:1788581267.615094:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788581267.615128:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62c00/0xf54e3944c2a70fe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.615138:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91906cb62c00/0xf54e3944c2a70fe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.615148:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91906cb62c00/0xf54e3944c2a70fe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581267.615165:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014278656:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788581267.615199:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581267.615337:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190768b20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581267.615485:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014278656 00000100:00100000:1.0:1788581267.615493:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014278656 00000100:00100000:1.0:1788581267.615620:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581267.615633:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+5:14399:x1875463014278656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581267.615649:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581267.615668:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919044ca9a00/0xf54e3944c2a70fec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a70fe5 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581267.615709:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca9a00/0xf54e3944c2a70fec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a70fe5 expref: 6 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581267.615721:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919044ca9a00/0xf54e3944c2a70fec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a70fe5 expref: 6 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581267.615733:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9a00, rc 0) 00000100:00100000:1.0:1788581267.615805:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+6:14399:x1875463014278656:12345-0@lo:101:mount.lustre.0 Request processed in 174us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581267.615813:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581267.615908:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014278656:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581267.615929:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91906cb62c00/0xf54e3944c2a70fe5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70fec expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.615939:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91906cb62c00/0xf54e3944c2a70fe5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a70fec expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581267.616022:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014278784:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581267.616065:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581267.616361:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190768b20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581267.616521:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014278784 00000100:00100000:3.0:1788581267.616526:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014278784 00000100:00100000:3.0:1788581267.616551:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788581267.616558:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f91a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+6:14399:x1875463014278784:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581267.616829:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f91a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+6:14399:x1875463014278784:12345-0@lo:501:mount.lustre.0 Request processed in 270us (765us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788581267.616837:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581267.616950:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014278784:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788581267.616978:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788581267.617097:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62c00/0xf54e3944c2a70fe5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70fec expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.617107:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91906cb62c00/0xf54e3944c2a70fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70fec expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581267.617115:0:14399:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff919059822800 10000000:01000000:2.0:1788581267.617120:0:14399:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788581267.617124:0:14399:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff919059822800 10000000:01000000:2.0:1788581267.617127:0:14399:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788581267.617130:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff919059822800 from 1 10000000:01000000:2.0:1788581267.617132:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788581267.617152:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62400/0xf54e3944c2a70ff3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.617160:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91906cb62400/0xf54e3944c2a70ff3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.617169:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91906cb62400/0xf54e3944c2a70ff3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581267.617183:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014278912:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788581267.617211:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581267.617232:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190768b20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581267.617386:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014278912 00000100:00100000:3.0:1788581267.617391:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014278912 00000100:00100000:3.0:1788581267.617415:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581267.617427:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f918450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+6:14399:x1875463014278912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581267.617437:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581267.617449:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821cea00/0xf54e3944c2a70ffa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a70ff3 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.617466:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821cea00/0xf54e3944c2a70ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a70ff3 expref: 7 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.617475:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821cea00/0xf54e3944c2a70ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a70ff3 expref: 7 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.617483:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cea00, rc 0) 00000100:00100000:3.0:1788581267.617517:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f918450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+7:14399:x1875463014278912:12345-0@lo:101:mount.lustre.0 Request processed in 90us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581267.617523:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788581267.617597:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014278912:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581267.617607:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91906cb62400/0xf54e3944c2a70ff3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70ffa expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.617616:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91906cb62400/0xf54e3944c2a70ff3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a70ffa expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581267.617631:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788581267.617796:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62400/0xf54e3944c2a70ff3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70ffa expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.617805:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91906cb62400/0xf54e3944c2a70ff3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70ffa expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581267.617812:0:14399:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788581267.617815:0:14399:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788581267.617820:0:14399:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff919059822800 10000000:01000000:2.0:1788581267.617822:0:14399:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788581267.617825:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788581267.617827:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788581267.617841:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb63600/0xf54e3944c2a71001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.617848:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91906cb63600/0xf54e3944c2a71001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.617855:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91906cb63600/0xf54e3944c2a71001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581267.617866:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014279040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788581267.617890:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581267.617917:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190768b20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581267.617958:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014279040 00000100:00100000:3.0:1788581267.617961:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014279040 00000100:00100000:3.0:1788581267.618000:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788581267.618006:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+7:14399:x1875463014279040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581267.618012:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581267.618020:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821cf200/0xf54e3944c2a71008 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a71001 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.618034:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821cf200/0xf54e3944c2a71008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a71001 expref: 8 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.618042:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821cf200/0xf54e3944c2a71008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a71001 expref: 8 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.618058:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf200, rc 0) 00000100:00100000:3.0:1788581267.618094:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+8:14399:x1875463014279040:12345-0@lo:101:mount.lustre.0 Request processed in 88us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581267.618099:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788581267.618482:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014279040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581267.618499:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91906cb63600/0xf54e3944c2a71001 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71008 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.618521:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91906cb63600/0xf54e3944c2a71001 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a71008 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581267.618604:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014279168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581267.618646:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581267.618694:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190768b20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581267.618782:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014279168 00000100:00100000:0.0:1788581267.618790:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014279168 00000100:00100000:0.0:1788581267.618834:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581267.618856:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904994f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+8:14399:x1875463014279168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581267.619876:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904994f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+9:14399:x1875463014279168:12345-0@lo:501:mount.lustre.0 Request processed in 1018us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581267.619887:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788581267.620085:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014279168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581267.620139:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014279296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581267.620201:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581267.620233:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190768b20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581267.621106:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014279296 00000100:00100000:0.0:1788581267.621117:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014279296 00000100:00100000:0.0:1788581267.621175:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581267.621184:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904994d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+9:14399:x1875463014279296:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788581267.621794:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904994d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+9:14399:x1875463014279296:12345-0@lo:503:mount.lustre.0 Request processed in 607us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581267.621804:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788581267.621967:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014279296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788581267.624722:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14434:1875463014279424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581267.624812:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581267.624852:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f4118c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581267.624962:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014279424 00000100:00100000:0.0:1788581267.624970:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014279424 00000100:00100000:0.0:1788581267.625105:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788581267.625115:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904994d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+9:14434:x1875463014279424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581267.625521:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904994d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+9:14434:x1875463014279424:12345-0@lo:502:llog_process_th.0 Request processed in 405us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581267.625528:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581267.625628:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14434:1875463014279424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788581267.625653:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581267.625662:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581267.625665:0:14434:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788581267.625670:0:14434:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788581267.625672:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788581267.625686:0:14434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff919046a6cd28) 00000020:00000080:3.0:1788581267.625702:0:14434:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788581267.625706:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788581267.625791:0:14434:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788581267.625801:0:14434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf54e3944c2a71016 00000020:00000080:3.0:1788581267.626014:0:14434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788581267.626018:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581267.626022:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581267.626023:0:14434:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788581267.626026:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581267.626029:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581267.626031:0:14434:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788581267.626034:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788581267.626041:0:14434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff919046a699b8) 00000020:00000080:3.0:1788581267.626051:0:14434:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788581267.626060:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788581267.626062:0:14434:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788581267.626064:0:14434:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788581267.626069:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788581267.626113:0:14434:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919059822800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788581267.626125:0:14434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff919046a68000) 00000020:00000080:3.0:1788581267.626132:0:14434:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788581267.626175:0:14434:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788581267.626180:0:14434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf54e3944c2a7102b 00000020:00000080:3.0:1788581267.626476:0:14434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788581267.626484:0:14434:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788581267.626489:0:14434:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf54e3944c2a71032 00080000:01000000:3.0:1788581267.626494:0:14434:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788581267.626497:0:14434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf54e3944c2a71039 00010000:00010000:2.0:1788581267.726571:0:14434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788581267.727548:0:14434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788581267.727749:0:14434:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788581267.728379:0:14434:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff919046473370) 00000020:00000080:2.0:1788581267.728398:0:14434:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788581267.728456:0:14434:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788581267.728466:0:14434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf54e3944c2a71047 00000020:00000080:0.0:1788581267.740102:0:14434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788581267.743484:0:14434:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf54e3944c2a7104e 00000020:00000080:1.0:1788581267.753064:0:14434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788581267.753080:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581267.753086:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581267.753088:0:14434:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788581267.753092:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581267.753099:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581267.753100:0:14434:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788581267.753104:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788581267.753146:0:14434:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788581267.753162:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581267.753164:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581267.753166:0:14434:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788581267.753168:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788581267.753170:0:14434:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1788581267.753172:0:14434:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788581267.753173:0:14434:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788581267.753175:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788581267.753177:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581267.753178:0:14434:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788581267.753181:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788581267.753194:0:14434:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788581267.753198:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581267.753199:0:14434:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788581267.753202:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788581267.753207:0:14434:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.113@tcp to nid 0x20000c0a8c971 (192.168.201.113@tcp) 00000020:01000000:1.0:1788581267.753232:0:14434:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788581267.753235:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788581267.753275:0:14434:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff919075ed0000) 00000020:00000080:1.0:1788581267.753294:0:14434:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788581267.753299:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788581267.753367:0:14434:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788581267.753376:0:14434:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788581267.753385:0:14434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf54e3944c2a7105c 00010000:00080000:1.0:1788581267.753422:0:14434:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919075ecc000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.113@tcp at head 00010000:00010000:1.0:1788581267.753778:0:14434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788581267.754976:0:14434:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788581267.755216:0:14434:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788581267.764195:0:14434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581267.764563:0:14434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788581267.764642:0:14434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788581267.768212:0:14438:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788581267.768223:0:14438:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788581267.770823:0:14434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788581267.770838:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788581267.770873:0:14434:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788581267.770895:0:14434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf54e3944c2a71063 00000100:00080000:1.0:1788581267.770907:0:14434:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788581267.770913:0:14434:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff919075ecc000 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:1.0:1788581267.770951:0:14434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907b97e300 x1875463014279552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581267.771076:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014279552:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788581267.771126:0:3337:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463014279552 offset 0 length 520: 4 00000100:00080000:1.0:1788581267.771182:0:14434:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788581267.771272:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581267.771281:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581267.771283:0:14434:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788581267.771287:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788581267.771290:0:14434:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1788581267.771291:0:14434:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788581267.771293:0:14434:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788581267.771295:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788581267.771297:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581267.771299:0:14434:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788581267.771301:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788581267.771305:0:14434:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788581267.771309:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581267.771310:0:14434:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788581267.771313:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788581267.771317:0:14434:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.113@tcp to nid 0x20000c0a8c971 (192.168.201.113@tcp) 00000020:01000000:1.0:1788581267.771335:0:14434:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788581267.771338:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788581267.771349:0:14434:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff919075ed19b8) 00000020:00000080:1.0:1788581267.771366:0:14434:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788581267.771369:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788581267.771422:0:14434:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788581267.771429:0:14434:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788581267.771434:0:14434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf54e3944c2a71071 00010000:00080000:1.0:1788581267.771459:0:14434:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919075ecd800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.113@tcp at head 00010000:00010000:1.0:1788581267.771683:0:14434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788581267.771850:0:14434:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788581267.771868:0:14434:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788581267.772435:0:14434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581267.772507:0:14434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788581267.772572:0:14434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1788581267.772887:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3340:1875463014279680:0@lo:400:kworker.0 00000100:00100000:3.0:1788581267.772949:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581267.773029:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014279680 00000100:00100000:3.0:1788581267.773038:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014279680 00000100:00100000:3.0:1788581267.773080:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788581267.773090:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904994f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+9:3340:x1875463014279680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581267.773139:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904994f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+9:3340:x1875463014279680:12345-0@lo:400:kworker.0 Request processed in 50us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581267.773145:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788581267.773210:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3340:1875463014279680:0@lo:400:kworker.0 00000040:00080000:3.0:1788581267.773895:0:14440:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788581267.773900:0:14440:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788581267.774808:0:14434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788581267.774822:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788581267.774859:0:14434:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788581267.774875:0:14434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf54e3944c2a71078 00000100:00080000:1.0:1788581267.774884:0:14434:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788581267.774890:0:14434:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff919075ecd800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:1.0:1788581267.774918:0:14434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907b97f100 x1875463014279808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581267.775013:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014279808:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788581267.775068:0:3337:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463014279808 offset 0 length 520: 4 00000100:00080000:1.0:1788581267.775357:0:14434:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788581267.775439:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581267.775444:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581267.775445:0:14434:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788581267.775448:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581267.775452:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581267.775453:0:14434:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788581267.775456:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788581267.775458:0:14434:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788581267.775460:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581267.775462:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581267.775464:0:14434:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788581267.775466:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581267.775468:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581267.775469:0:14434:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788581267.775473:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788581267.775507:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14434:1875463014279936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581267.775551:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581267.775592:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076c35d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581267.775769:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014279936 00000100:00100000:2.0:1788581267.775777:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014279936 00000100:00100000:2.0:1788581267.775831:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581267.775840:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904994e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+9:14434:x1875463014279936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581267.776099:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904994e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+9:14434:x1875463014279936:12345-0@lo:502:llog_process_th.0 Request processed in 259us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581267.776107:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788581267.776300:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14434:1875463014279936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788581267.776338:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581267.776346:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581267.776348:0:14434:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788581267.776354:0:14434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788581267.779839:0:14399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788581267.779878:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788581267.779902:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb63600/0xf54e3944c2a71001 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71008 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.779915:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91906cb63600/0xf54e3944c2a71001 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71008 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581267.779924:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff919059822800 from 1 10000000:01000000:2.0:1788581267.779927:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788581267.779973:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62200/0xf54e3944c2a7107f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.779982:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91906cb62200/0xf54e3944c2a7107f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.780167:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91906cb62200/0xf54e3944c2a7107f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581267.780195:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014280064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788581267.780296:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581267.780334:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190768b2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788581267.780408:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014280064 00000100:00100000:0.0:1788581267.780417:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014280064 00000100:00100000:0.0:1788581267.780462:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788581267.780470:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+9:14399:x1875463014280064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581267.780507:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581267.780522:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71086 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a7107f expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581267.780544:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a7107f expref: 10 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581267.780553:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a7107f expref: 10 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581267.780561:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22e00, rc 0) 00000100:00100000:0.0:1788581267.780613:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+10:14399:x1875463014280064:12345-0@lo:101:mount.lustre.0 Request processed in 144us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581267.780620:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581267.780831:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014280064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581267.780851:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91906cb62200/0xf54e3944c2a7107f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71086 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581267.780862:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91906cb62200/0xf54e3944c2a7107f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a71086 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581267.781388:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014280192:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788581267.781509:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581267.781538:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076c35d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581267.781933:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014280192 00000100:00100000:2.0:1788581267.781943:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014280192 00000100:00100000:2.0:1788581267.782117:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788581267.782132:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+10:14399:x1875463014280192:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788581267.782156:0:14410:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788581267.782163:0:14410:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788581267.782278:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+10:14399:x1875463014280192:12345-0@lo:256:mount.lustre.0 Request processed in 152us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581267.782286:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581267.782740:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014280192:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788581267.783825:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788581267.783934:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62200/0xf54e3944c2a7107f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71086 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581267.783947:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91906cb62200/0xf54e3944c2a7107f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71086 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581267.783956:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919059822800 from 1 10000000:01000000:1.0:1788581267.783960:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788581267.784025:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca8400/0xf54e3944c2a7108d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581267.784036:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919044ca8400/0xf54e3944c2a7108d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581267.784046:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919044ca8400/0xf54e3944c2a7108d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581267.784070:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014280320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788581267.784149:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581267.784207:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076c35d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581267.784520:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014280320 00000100:00100000:2.0:1788581267.784527:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014280320 00000100:00100000:2.0:1788581267.784569:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788581267.784588:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+10:14399:x1875463014280320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788581267.784600:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581267.784615:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91906cb63400/0xf54e3944c2a71094 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a7108d expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.784646:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91906cb63400/0xf54e3944c2a71094 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a7108d expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.784656:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91906cb63400/0xf54e3944c2a71094 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a7108d expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.784663:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91906cb63400, rc 0) 00000100:00100000:2.0:1788581267.784708:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+11:14399:x1875463014280320:12345-0@lo:101:mount.lustre.0 Request processed in 131us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581267.784714:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581267.785004:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014280320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581267.785020:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919044ca8400/0xf54e3944c2a7108d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71094 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581267.785028:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919044ca8400/0xf54e3944c2a7108d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a71094 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581267.785084:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014280448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581267.785111:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581267.785144:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076c35d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581267.785272:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014280448 00000100:00100000:2.0:1788581267.785277:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014280448 00000100:00100000:2.0:1788581267.785302:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788581267.785308:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+11:14399:x1875463014280448:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581267.789157:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+11:14399:x1875463014280448:12345-0@lo:501:mount.lustre.0 Request processed in 3839us (4035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581267.789172:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788581267.791227:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014280448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581267.791378:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014280576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581267.791446:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581267.791551:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076c35d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581267.791711:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014280576 00000100:00100000:3.0:1788581267.791719:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014280576 00000100:00100000:3.0:1788581267.791811:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788581267.791821:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+11:14399:x1875463014280576:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788581267.792036:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+11:14399:x1875463014280576:12345-0@lo:503:mount.lustre.0 Request processed in 216us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581267.792043:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788581267.792117:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014280576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581267.792821:0:14442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14442:1875463014280704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581267.792875:0:14442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581267.793477:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014280704 00000100:00100000:2.0:1788581267.793619:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014280704 00000100:00100000:2.0:1788581267.793686:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581267.793699:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+11:14442:x1875463014280704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581267.794468:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+11:14442:x1875463014280704:12345-0@lo:502:llog_process_th.0 Request processed in 768us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581267.794479:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581267.795393:0:14442:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076c35900 going to sleep for 11 seconds 00000100:00100000:2.0:1788581267.795431:0:14442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14442:1875463014280704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788581267.795477:0:14442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581267.795602:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581267.795607:0:14442:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788581267.795619:0:14442:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff919059822800 00000020:00000080:2.0:1788581267.795622:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788581267.795743:0:14442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581267.795751:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581267.795753:0:14442:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788581267.795757:0:14442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581267.795760:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581267.795762:0:14442:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788581267.795766:0:14442:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff919059822800 00000020:00000080:2.0:1788581267.795768:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788581267.796217:0:14442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581267.796227:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581267.796228:0:14442:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788581267.796232:0:14442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581267.796236:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581267.796237:0:14442:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788581267.796295:0:14442:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff919059822800 00000020:00000080:2.0:1788581267.796312:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788581267.801225:0:14442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14442:1875463014280832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581267.801330:0:14442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581267.801393:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014280832 00000100:00100000:2.0:1788581267.801403:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014280832 00000100:00100000:2.0:1788581267.801466:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581267.801502:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+11:14442:x1875463014280832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581267.801805:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+11:14442:x1875463014280832:12345-0@lo:502:llog_process_th.0 Request processed in 329us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581267.801814:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581267.801873:0:14442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190768b2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788581267.801894:0:14442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14442:1875463014280832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788581267.801930:0:14442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581267.801937:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581267.801940:0:14442:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788581267.801944:0:14442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788581267.802362:0:14399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788581267.802381:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788581267.802404:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca8400/0xf54e3944c2a7108d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71094 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581267.802416:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919044ca8400/0xf54e3944c2a7108d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71094 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581267.802457:0:14399:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788581267.802460:0:14399:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff919059822800 10000000:01000000:0.0:1788581267.802463:0:14399:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff919059822800 10000000:01000000:0.0:1788581267.802467:0:14399:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788581267.802472:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff919059822800 from 1 10000000:01000000:0.0:1788581267.802474:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788581267.802509:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bc23400/0xf54e3944c2a7109b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581267.802523:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91907bc23400/0xf54e3944c2a7109b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581267.802533:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91907bc23400/0xf54e3944c2a7109b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581267.802550:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b910000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014280960:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788581267.802594:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581267.802617:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff919050ace240 going to sleep for 11 seconds 00000100:00100000:0.0:1788581267.802644:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014280960 00000100:00100000:0.0:1788581267.802649:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014280960 00000100:00100000:0.0:1788581267.802674:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788581267.802680:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+11:14399:x1875463014280960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581267.802690:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581267.802701:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91907bc22000/0xf54e3944c2a710a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a7109b expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581267.802721:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91907bc22000/0xf54e3944c2a710a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a7109b expref: 12 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581267.802732:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91907bc22000/0xf54e3944c2a710a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a7109b expref: 12 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581267.802741:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22000, rc 0) 00000100:00100000:0.0:1788581267.802767:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14399:x1875463014280960:12345-0@lo:101:mount.lustre.0 Request processed in 87us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581267.802773:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788581267.802808:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b910000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014280960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581267.802820:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91907bc23400/0xf54e3944c2a7109b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a710a2 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581267.802829:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91907bc23400/0xf54e3944c2a7109b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a710a2 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581267.802867:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b910000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014281088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581267.802889:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581267.802898:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff919050ace240 going to sleep for 11 seconds 00000100:00100000:2.0:1788581267.805825:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014281088 00000100:00100000:2.0:1788581267.805841:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014281088 00000100:00100000:2.0:1788581267.805945:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788581267.805956:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14399:x1875463014281088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581267.806324:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14399:x1875463014281088:12345-0@lo:501:mount.lustre.0 Request processed in 369us (3432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581267.806332:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788581267.807693:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b910000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014281088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581267.807750:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b910000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014281216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788581267.807804:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581267.807840:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff919050ace240 going to sleep for 11 seconds 00000100:00100000:2.0:1788581267.807980:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014281216 00000100:00100000:2.0:1788581267.807986:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014281216 00000100:00100000:2.0:1788581267.808033:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788581267.808041:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14399:x1875463014281216:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581267.808211:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14399:x1875463014281216:12345-0@lo:503:mount.lustre.0 Request processed in 170us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581267.808219:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788581267.808691:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b910000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014281216:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581267.809773:0:14444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14444:1875463014281344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581267.809830:0:14444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581267.815200:0:14444:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076c350c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581267.823091:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014281344 00000100:00100000:2.0:1788581267.823106:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014281344 00000100:00100000:2.0:1788581267.823181:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788581267.823191:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14444:x1875463014281344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581267.823602:0:14444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14444:1875463014281344:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788581267.829173:0:14444:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788581267.829196:0:14444:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff919076214d28) 00000020:00000080:0.0:1788581267.829226:0:14444:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788581267.829378:0:14444:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919059822800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788581267.829385:0:14444:0:(tgt_mount.c:187:server_put_mount()) put mount ffff919059822800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788581267.829388:0:14444:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919059822800 4 00010000:00080000:0.0:1788581267.829427:0:14444:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919048c92800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.113@tcp at head 00000100:00100000:2.0:1788581267.831767:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14444:x1875463014281344:12345-0@lo:502:llog_process_th.0 Request processed in 8563us (21922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581267.831783:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788581267.844926:0:14444:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788581267.846281:0:14444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788581267.846322:0:14444:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788581267.846343:0:14444:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf54e3944c2a710b0 00000100:00080000:0.0:1788581267.846355:0:14444:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788581267.846375:0:14444:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff919048c92800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:0.0:1788581267.846419:0:14444:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907b911180 x1875463014281472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788581267.846460:0:14444:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788581267.848948:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3337:1875463014281472:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788581267.849060:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581267.849665:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014281472 00000100:00100000:0.0:1788581267.849676:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014281472 00000100:00100000:0.0:1788581267.849711:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788581267.849719:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3337:x1875463014281472:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788581267.849783:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3337:x1875463014281472:12345-0@lo:38:llog_process_th.0 Request processed in 63us (723us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788581267.849790:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581267.849958:0:3337:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788581267.849966:0:3337:0:(import.c:65:import_set_state_nolock()) ffff919048c92800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788581267.849970:0:3337:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788581267.849973:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3337:1875463014281472:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788581267.853424:0:14444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b912d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14444:1875463014281600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581267.853509:0:14444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581267.853548:0:14444:0:(client.c:2715:ptlrpc_set_wait()) set ffff919050ace240 going to sleep for 11 seconds 00000100:00100000:2.0:1788581267.853759:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014281600 00000100:00100000:2.0:1788581267.853768:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014281600 00000100:00100000:2.0:1788581267.853812:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788581267.853820:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14444:x1875463014281600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581267.854107:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14444:x1875463014281600:12345-0@lo:502:llog_process_th.0 Request processed in 287us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581267.854115:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788581267.854459:0:14444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b912d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14444:1875463014281600:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788581267.854488:0:14444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788581267.854628:0:14399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788581267.854650:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788581267.854668:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bc23400/0xf54e3944c2a7109b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a710a2 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581267.854679:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91907bc23400/0xf54e3944c2a7109b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a710a2 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788581267.854726:0:14399:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788581267.854728:0:14399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788581267.854734:0:14399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581267.854735:0:14399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581267.854736:0:14399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581267.854737:0:14399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581267.854738:0:14399:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581267.854740:0:14399:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788581267.854741:0:14399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581267.854742:0:14399:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788581267.854746:0:14399:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788581267.854748:0:14399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788581267.854749:0:14399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788581267.854750:0:14399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581267.854751:0:14399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581267.854752:0:14399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581267.854753:0:14399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581267.854754:0:14399:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581267.854755:0:14399:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788581267.854756:0:14399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581267.854757:0:14399:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788581267.854774:0:14399:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788581267.854787:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014281728:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788581267.854826:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581267.854861:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff919049d5ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581267.855147:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014281728 00000100:00100000:1.0:1788581267.855154:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014281728 00000100:00100000:1.0:1788581267.855193:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788581267.855200:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14399:x1875463014281728:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788581267.855221:0:14412:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788581267.855234:0:14412:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788581267.922496:0:14412:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788581267.922508:0:14412:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788581267.922908:0:14432:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788581267.922914:0:14432:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788581267.922935:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.922953:0:14432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a7107f expref: 12 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.922962:0:14432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710b7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923009:0:14432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a7107f expref: 12 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923023:0:14432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71086 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a7107f expref: 12 pid: 14412 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581267.923038:0:14432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14432:1875463014281856:0@lo:104: 00000100:00100000:3.0:1788581267.923095:0:14432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581267.923135:0:14432:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f411ea840 going to sleep for 11 seconds 00000100:00100000:3.0:1788581267.923168:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014281856 00000100:00100000:3.0:1788581267.923174:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014281856 00000100:00100000:3.0:1788581267.923208:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581267.923228:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+3:14432:x1875463014281856:12345-0@lo:104: 00010000:00010000:3.0:1788581267.923264:0:14400:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91906cb62200/0xf54e3944c2a7107f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a71086 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923309:0:14400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788581267.923315:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+3:14432:x1875463014281856:12345-0@lo:104: Request processed in 88us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581267.923322:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788581267.923342:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581267.923348:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91906cb62200/0xf54e3944c2a7107f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a71086 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923355:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb62200 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:3.0:1788581267.923359:0:14406:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91906cb62200/0xf54e3944c2a7107f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a71086 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923368:0:14406:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91906cb62200/0xf54e3944c2a7107f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a71086 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581267.923376:0:14406:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91906cb62200/0xf54e3944c2a7107f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a71086 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581267.923382:0:14406:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788581267.923408:0:14406:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91906cb62200/0xf54e3944c2a7107f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a71086 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923415:0:14406:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581267.923431:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91906cb62200/0xf54e3944c2a7107f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a71086 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923449:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91906cb62200/0xf54e3944c2a7107f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a71086 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923464:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581267.923465:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581267.923467:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581267.923477:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3341:1875463014281984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581267.923502:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581267.923542:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014281984 00000100:00100000:3.0:1788581267.923546:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014281984 00010000:00010000:3.0:1788581267.923560:0:14402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71086 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a7107f expref: 13 pid: 14412 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581267.923595:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581267.923601:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+13:3341:x1875463014281984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581267.923611:0:14402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581267.923615:0:14402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71086 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a7107f expref: 13 pid: 14412 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923813:0:14402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71086 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a7107f expref: 13 pid: 14412 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923830:0:14402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710b7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923838:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710b7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788581267.923850:0:14402:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000936848s 00010000:00010000:3.0:1788581267.923860:0:14402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923867:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923874:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710b7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923880:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923885:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cee00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581267.923890:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923897:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710b7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923905:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710b7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.923915:0:14402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581267.923957:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+13:3341:x1875463014281984:12345-0@lo:103:ldlm_bl.0 Request processed in 356us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581267.923964:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581267.925431:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3341:1875463014281984:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581267.926172:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71086 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a7107f expref: 12 pid: 14412 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581267.926189:0:14432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14432:1875463014281856:0@lo:104: 00010000:00010000:3.0:1788581267.926209:0:14432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710b7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.926230:0:14432:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710b7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.926237:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710b7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581267.926259:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710b7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581267.933543:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+11:14399:x1875463014281728:12345-0@lo:253:mount.lustre.0 Request processed in 78332us (78705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581267.933559:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788581267.933663:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14399:1875463014281728:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788581267.933680:0:14399:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788581267.933684:0:14399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788581267.933686:0:14399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788581267.933687:0:14399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581267.933688:0:14399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581267.933689:0:14399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581267.933690:0:14399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581267.933692:0:14399:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788581267.933693:0:14399:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788581267.933695:0:14399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581267.933696:0:14399:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788581267.933715:0:14399:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788581267.941130:0:14399:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788581267.941422:0:14399:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788581267.941674:0:14399:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788581267.941798:0:14399:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788581267.942789:0:14399:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788581267.942938:0:14399:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788581267.950063:0:14399:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788581267.950355:0:14399:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788581267.950935:0:14399:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788581267.951724:0:14399:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788581267.952003:0:14399:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788581267.952155:0:14399:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788581267.998842:0:14399:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788581267.999644:0:14399:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788581267.999870:0:14455:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788581267.999874:0:14455:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788581268.001313:0:14456:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788581268.001405:0:14456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581268.005861:0:14456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788581268.005925:0:14456:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788581268.005929:0:14456:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788581268.010803:0:14399:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788581268.013843:0:14399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788581268.014288:0:14399:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788581268.014305:0:14399:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788581268.014571:0:14399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788581268.015637:0:14399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788581268.016323:0:14399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788581268.016352:0:14399:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788581268.022829:0:14399:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788581268.033162:0:14399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788581268.093128:0:14399:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788581268.093707:0:14399:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4bbc1c7b988 00100000:10000000:3.0:1788581268.093716:0:14399:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788581268.096374:0:14399:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788581268.096394:0:14399:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788581268.096421:0:14399:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788581268.096451:0:14399:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788581268.466892:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581268.916030:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788581269.039307:0:14414:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788581269.039315:0:14414:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff919059822800 from 6 10000000:01000000:2.0:1788581269.039320:0:14414:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788581269.039371:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb63800/0xf54e3944c2a710be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581269.039383:0:14414:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91906cb63800/0xf54e3944c2a710be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581269.039395:0:14414:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91906cb63800/0xf54e3944c2a710be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581269.039421:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014282112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788581269.039493:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581269.039551:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff919049d5c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581269.039581:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014282112 00000100:00100000:3.0:1788581269.039590:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014282112 00000100:00100000:3.0:1788581269.039649:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788581269.039661:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+11:14414:x1875463014282112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581269.039675:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581269.039693:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a710be expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581269.039717:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a710be expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581269.039728:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a710be expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581269.039738:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cee00, rc 0) 00000100:00100000:3.0:1788581269.039789:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14414:x1875463014282112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581269.039796:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788581269.040149:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014282112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581269.040166:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91906cb63800/0xf54e3944c2a710be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a710c5 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581269.040176:0:14414:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91906cb63800/0xf54e3944c2a710be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a710c5 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581269.040240:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014282240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788581269.040291:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581269.040321:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076c35240 going to sleep for 11 seconds 00000100:00100000:2.0:1788581269.040329:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014282240 00000100:00100000:2.0:1788581269.040334:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014282240 00000100:00100000:2.0:1788581269.040366:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788581269.040373:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14414:x1875463014282240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788581269.040387:0:14412:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788581269.040402:0:14412:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788581269.040405:0:14412:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788581269.040490:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14414:x1875463014282240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581269.040497:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788581269.040545:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014282240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788581269.040608:0:14414:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788581269.040615:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb63800/0xf54e3944c2a710be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a710c5 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581269.040624:0:14414:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91906cb63800/0xf54e3944c2a710be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a710c5 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581269.489379:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581269.937020:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788581270.515406:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581271.535891:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581272.559538:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788581273.029010:0:14699:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788581273.206156:0:12643:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581273.206164:0:12643:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581273.206167:0:12643:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581273.206170:0:12643:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581273.206173:0:12643:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788581273.206176:0:12643:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788581273.206180:0:12643:0:(import.c:65:import_set_state_nolock()) ffff919048c92800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788581273.206193:0:12643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff919048c92800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:1.0:1788581273.206217:0:12643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907b97c380 x1875463014282496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581273.206380:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3338:1875463014282368:0@lo:400:kworker.0 00000100:00100000:1.0:1788581273.206461:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581273.206532:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3337:1875463014282496:0@lo:38:kworker.0 00000100:00100000:1.0:1788581273.206558:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581273.209829:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014282368 00000100:00100000:0.0:1788581273.209855:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014282368 00000100:00100000:0.0:1788581273.209916:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788581273.209927:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:3338:x1875463014282368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581273.210025:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:3338:x1875463014282368:12345-0@lo:400:kworker.0 Request processed in 100us (3564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581273.210033:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788581273.210111:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3338:1875463014282368:0@lo:400:kworker.0 00000100:00100000:2.0:1788581273.219901:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014282496 00000100:00100000:2.0:1788581273.219915:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014282496 00000100:00100000:2.0:1788581273.219961:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581273.219969:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3337:x1875463014282496:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788581273.219996:0:14418:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:2.0:1788581273.220033:0:14418:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf54e3944c2a710cc 00000004:00100000:2.0:1788581273.220050:0:14418:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788581273.220180:0:14418:0:(import.c:65:import_set_state_nolock()) ffff919076117000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581273.220301:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3337:x1875463014282496:12345-0@lo:38:kworker.0 Request processed in 332us (13740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581273.220309:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788581273.221469:0:3337:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91907b97c380 x1875463014282496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788581273.221500:0:3337:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788581273.221509:0:3337:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788581273.221515:0:3337:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788581273.221518:0:3337:0:(import.c:65:import_set_state_nolock()) ffff919048c92800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788581273.221525:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3337:1875463014282496:0@lo:38:kworker.0 00010000:00010000:0.0:1788581273.584235:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581274.609866:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581275.634419:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788581276.100780:0:14849:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcbc562fd0 20000000:00000080:1.0:1788581276.100799:0:14849:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91907cd15400 uarg=0000000000000000 20000000:01000000:1.0:1788581276.100832:0:14849:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788581276.100839:0:14849:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788581276.100844:0:14849:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788581276.103869:0:14850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788581276.104158:0:14849:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788581276.111268:0:14849:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788581276.111301:0:14849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91906cb63a00/0xf54e3944c2a710d3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581276.111321:0:14849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91906cb63400/0xf54e3944c2a71094 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a7108d expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581276.111330:0:14849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91906cb63a00/0xf54e3944c2a710d3 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581276.111372:0:14849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91906cb63400/0xf54e3944c2a71094 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a7108d expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581276.111384:0:14849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91906cb63400/0xf54e3944c2a71094 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a7108d expref: 11 pid: 14410 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581276.111413:0:14849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14849:1875463014282624:0@lo:104: 00000100:00100000:2.0:1788581276.111615:0:14849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581276.111667:0:14849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190467e56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581276.112143:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014282624 00000100:00100000:0.0:1788581276.112152:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014282624 00000100:00100000:0.0:1788581276.112196:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788581276.112206:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+3:14849:x1875463014282624:12345-0@lo:104: 00010000:00010000:0.0:1788581276.112221:0:14401:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff919044ca8400/0xf54e3944c2a7108d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a71094 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581276.112314:0:14401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581276.112320:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+3:14849:x1875463014282624:12345-0@lo:104: Request processed in 116us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581276.112328:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581276.112427:0:14849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14849:1875463014282624:0@lo:104: 00010000:00010000:1.0:1788581276.112457:0:14849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91906cb63a00/0xf54e3944c2a710d3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.112543:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581276.112551:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919044ca8400/0xf54e3944c2a7108d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a71094 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.112559:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8400 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:3.0:1788581276.112575:0:14405:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919044ca8400/0xf54e3944c2a7108d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a71094 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.112585:0:14405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919044ca8400/0xf54e3944c2a7108d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a71094 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581276.112593:0:14405:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919044ca8400/0xf54e3944c2a7108d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a71094 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581276.112601:0:14405:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788581276.112639:0:14405:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919044ca8400/0xf54e3944c2a7108d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a71094 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.112646:0:14405:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581276.112666:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919044ca8400/0xf54e3944c2a7108d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a71094 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.112674:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919044ca8400/0xf54e3944c2a7108d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a71094 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.112691:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581276.112692:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581276.112694:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581276.112701:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581276.112712:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3338:1875463014282752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581276.112748:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581276.112798:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014282752 00000100:00100000:3.0:1788581276.112803:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014282752 00010000:00010000:3.0:1788581276.112822:0:14403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91906cb63400/0xf54e3944c2a71094 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a7108d expref: 12 pid: 14410 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581276.112867:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581276.112875:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:3338:x1875463014282752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788581276.112886:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581276.112891:0:14403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91906cb63400/0xf54e3944c2a71094 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a7108d expref: 12 pid: 14410 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.112901:0:14403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91906cb63400/0xf54e3944c2a71094 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a7108d expref: 12 pid: 14410 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.112915:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91906cb63400/0xf54e3944c2a71094 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a7108d expref: 12 pid: 14410 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.112929:0:14403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91906cb63a00/0xf54e3944c2a710d3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.112937:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91906cb63a00/0xf54e3944c2a710d3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.112951:0:14403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91906cb63a00/0xf54e3944c2a710d3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.112959:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91906cb63a00/0xf54e3944c2a710d3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.112965:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91906cb63a00/0xf54e3944c2a710d3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.112973:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91906cb63a00/0xf54e3944c2a710d3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.112988:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb63a00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581276.112992:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91906cb63a00/0xf54e3944c2a710d3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.113000:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91906cb63a00/0xf54e3944c2a710d3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.113012:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91906cb63a00/0xf54e3944c2a710d3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581276.113021:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581276.113048:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+11:3338:x1875463014282752:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581276.113055:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581276.113086:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3338:1875463014282752:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581276.113209:0:14849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91906cb63a00/0xf54e3944c2a710d3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581276.113218:0:14849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91906cb63a00/0xf54e3944c2a710d3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581276.113225:0:14849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91906cb63a00/0xf54e3944c2a710d3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581276.662140:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581277.306456:0:3337:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581267/real 1788581267] req@ffff91907b97f100 x1875463014279808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581277 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581277.306498:0:3337:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91907b97f100 x1875463014279808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581277 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581277.306510:0:3337:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581267/real 1788581267] req@ffff91907b97e300 x1875463014279552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581277 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581277.306523:0:3337:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91907b97e300 x1875463014279552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581277 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788581277.306545:0:3337:0:(import.c:65:import_set_state_nolock()) ffff919075ecd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788581277.306574:0:3337:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788581277.306580:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014279808:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788581277.306586:0:3337:0:(import.c:65:import_set_state_nolock()) ffff919075ecc000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788581277.306592:0:3337:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788581277.306595:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014279552:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788581277.306708:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581277.306712:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788581277.306714:0:38:0:(import.c:65:import_set_state_nolock()) ffff919075ecc000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581277.306721:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:2.0:1788581277.306899:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788581277.306909:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff919075ecc000 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:2.0:1788581277.306936:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9190768c8e00 x1875463014283008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788581277.306951:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581277.306955:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788581277.306956:0:38:0:(import.c:65:import_set_state_nolock()) ffff919075ecd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581277.306960:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:2.0:1788581277.306962:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788581277.306967:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff919075ecd800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:2.0:1788581277.306978:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9190768cb100 x1875463014283136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581277.307018:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014283264:0@lo:400:kworker.0 00000100:00100000:2.0:1788581277.307107:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581277.307165:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788581277.307170:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3341:1875463014282880:0@lo:400:kworker.0 00000100:00100000:2.0:1788581277.307198:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581277.307883:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014283264 00000100:00100000:2.0:1788581277.307896:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014283264 00000100:00100000:2.0:1788581277.307954:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581277.307965:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014283264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581277.308040:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3341:x1875463014283264:12345-0@lo:400:kworker.0 Request processed in 76us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581277.308049:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581277.308083:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014283008:0@lo:8:kworker.0 00000400:00000100:2.0:1788581277.308117:0:3337:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463014283008 offset 0 length 520: 4 00000100:00100000:2.0:1788581277.308133:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014283136:0@lo:8:kworker.0 00000400:00000100:2.0:1788581277.308148:0:3337:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875463014283136 offset 0 length 520: 4 00010000:00080000:2.0:1788581277.308189:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9190768ca300 x1875463014283264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581277.308204:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3341:1875463014283264:0@lo:400:kworker.0 00000100:00100000:3.0:1788581277.313620:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014282880 00000100:00100000:3.0:1788581277.313643:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014282880 00000100:00100000:3.0:1788581277.313749:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788581277.313763:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+11:3341:x1875463014282880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581277.313893:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+11:3341:x1875463014282880:12345-0@lo:400:kworker.0 Request processed in 133us (6692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581277.313901:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788581277.314350:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3341:1875463014282880:0@lo:400:kworker.0 00010000:00010000:3.0:1788581277.680105:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788581278.065619:0:14414:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788581278.065629:0:14414:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919059822800 from 10 10000000:01000000:2.0:1788581278.065637:0:14414:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788581278.065698:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62600/0xf54e3944c2a710da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581278.065712:0:14414:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91906cb62600/0xf54e3944c2a710da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581278.065727:0:14414:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91906cb62600/0xf54e3944c2a710da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581278.065764:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014283392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788581278.066131:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581278.066213:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190467e5180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581278.066298:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014283392 00000100:00100000:0.0:1788581278.066309:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014283392 00000100:00100000:0.0:1788581278.066385:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788581278.066396:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+11:14414:x1875463014283392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581278.066422:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581278.066449:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a710e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a710da expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581278.066477:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a710e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a710da expref: 12 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581278.066498:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a710e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a710da expref: 12 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581278.066509:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22a00, rc 0) 00000100:00100000:0.0:1788581278.066561:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14414:x1875463014283392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581278.066569:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788581278.069130:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014283392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581278.069173:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91906cb62600/0xf54e3944c2a710da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a710e1 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581278.069209:0:14414:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91906cb62600/0xf54e3944c2a710da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a710e1 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581278.069357:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014283520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581278.069564:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581278.069619:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190467e5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788581278.071672:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014283520 00000100:00100000:3.0:1788581278.071695:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014283520 00000100:00100000:3.0:1788581278.071791:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788581278.071805:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14414:x1875463014283520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581278.074534:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14414:x1875463014283520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2717us (4955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581278.074553:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788581278.074730:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014283520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581278.074824:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b913800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014283648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581278.074959:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581278.075005:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff919046ab1240 going to sleep for 11 seconds 00000100:00100000:2.0:1788581278.075137:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014283648 00000100:00100000:2.0:1788581278.075146:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014283648 00000100:00100000:2.0:1788581278.075206:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788581278.075217:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14414:x1875463014283648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581278.075687:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:14414:x1875463014283648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 470us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581278.075696:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788581278.078927:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b913800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014283648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788581278.082659:0:14911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788581278.083607:0:14414:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788581278.083645:0:14414:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788581278.083663:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62600/0xf54e3944c2a710da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a710e1 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581278.083677:0:14414:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91906cb62600/0xf54e3944c2a710da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a710e1 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581278.706034:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788581279.157644:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788581279.728599:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581280.751674:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581281.778668:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788581282.137613:0:15098:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788581282.137617:0:15098:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788581282.137743:0:15098:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff919050d45000 00000020:01000004:1.0:1788581282.137758:0:15098:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788581282.137769:0:15098:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788581282.137781:0:15098:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff919075ed4d28) 00000020:00000080:1.0:1788581282.137795:0:15098:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788581282.158883:0:15098:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788581282.159340:0:15098:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788581282.160430:0:15098:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788581282.160788:0:15098:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788581282.161157:0:15098:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788581282.161632:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 675: rc = 0 00100000:10000000:0.0:1788581282.161756:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 675: rc = 0 00100000:10000000:0.0:1788581282.161814:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 675: rc = 0 00100000:10000000:0.0:1788581282.162679:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 545: rc = 0 00100000:10000000:0.0:1788581282.162989:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 545: rc = 0 00100000:10000000:0.0:1788581282.163355:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 545: rc = 0 00100000:10000000:0.0:1788581282.163771:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 545: rc = 0 00100000:10000000:0.0:1788581282.163983:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 545: rc = 0 00100000:10000000:0.0:1788581282.164306:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 545: rc = 0 00000020:00000080:0.0:1788581282.164818:0:15098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788581282.164828:0:15098:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788581282.164837:0:15098:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf54e3944c2a710ef 00000020:01000004:0.0:1788581282.164843:0:15098:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788581282.164861:0:15098:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.113@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788581282.164863:0:15098:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788581282.164868:0:15098:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788581282.164870:0:15098:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788581282.164879:0:15098:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9190762119b8) 00000020:00000080:0.0:1788581282.164886:0:15098:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788581282.166553:0:15098:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788581282.166730:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788581282.166737:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788581282.167480:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788581282.167487:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788581282.169147:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788581282.169171:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788581282.172625:0:15098:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581282.172807:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788581282.172813:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788581282.173498:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788581282.173506:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788581282.186564:0:15098:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581282.186849:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788581282.186857:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788581282.189157:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788581282.189170:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788581282.189963:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788581282.189972:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788581282.191633:0:15098:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788581282.191832:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788581282.191839:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788581282.192977:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788581282.192988:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788581282.244779:0:15098:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581282.244978:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788581282.244985:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788581282.246785:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788581282.246800:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788581282.247624:0:15098:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788581282.247650:0:15098:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788581282.247657:0:15098:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788581282.257886:0:15098:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788581282.257923:0:15098:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.113@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788581282.257926:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788581282.257930:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788581282.257930:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581282.257931:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581282.257932:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581282.257933:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581282.257934:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581282.257935:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581282.257936:0:15098:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788581282.257939:0:15098:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788581282.257941:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788581282.257941:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788581282.257942:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581282.257943:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581282.257943:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581282.257944:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581282.257944:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581282.257945:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581282.257946:0:15098:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788581282.257973:0:15098:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788581282.257995:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014283776:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788581282.258083:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581282.258210:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907b9099c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581282.258367:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014283776 00000100:00100000:3.0:1788581282.258376:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014283776 00000100:00100000:3.0:1788581282.258432:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788581282.258442:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:15098:x1875463014283776:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788581282.258472:0:14411:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788581282.258475:0:14411:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788581282.258479:0:14411:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788581282.263055:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:15098:x1875463014283776:12345-0@lo:253:mount.lustre.0 Request processed in 4600us (4957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581282.263068:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014283776:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788581282.263071:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 10000000:01000000:1.0:1788581282.263083:0:15098:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788581282.263087:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788581282.263088:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788581282.263089:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581282.263091:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788581282.263092:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581282.263093:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581282.263095:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581282.263097:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581282.263098:0:15098:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788581282.263120:0:15098:0:(tgt_mount.c:101:server_register_mount()) register mount ffff919050d45000 from lustre-OST0000 10000000:01000000:1.0:1788581282.263169:0:15098:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788581282.263173:0:15098:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788581282.263180:0:15098:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff919076213370 local copy 00010000:00010000:1.0:1788581282.263198:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62c00/0xf54e3944c2a70fe5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70fec expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581282.263448:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014283904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581282.263491:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581282.263536:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907b909900 going to sleep for 11 seconds 00000100:00100000:0.0:1788581282.263946:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014283904 00000100:00100000:0.0:1788581282.263952:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014283904 00000100:00100000:0.0:1788581282.263991:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788581282.264000:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:15098:x1875463014283904:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581282.264147:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:15098:x1875463014283904:12345-0@lo:501:mount.lustre.0 Request processed in 147us (655us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788581282.264160:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788581282.264180:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014283904:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788581282.264194:0:15098:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788581282.264385:0:15098:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788581282.264394:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62c00/0xf54e3944c2a70fe5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70fec expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.264403:0:15098:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91906cb62c00/0xf54e3944c2a70fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70fec expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581282.264423:0:15098:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff919050d45000 10000000:01000000:1.0:1788581282.264428:0:15098:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788581282.264433:0:15098:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff919076213370 10000000:01000000:1.0:1788581282.264435:0:15098:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788581282.264439:0:15098:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff919076213370 from 1 10000000:01000000:1.0:1788581282.264441:0:15098:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788581282.264466:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a710fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.264474:0:15098:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a710fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.264483:0:15098:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a710fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581282.264510:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014284032:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788581282.264539:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581282.264833:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014284032 00000100:00100000:0.0:1788581282.264838:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014284032 00000100:00100000:1.0:1788581282.264845:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907b909900 going to sleep for 11 seconds 00000100:00100000:3.0:1788581282.264937:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788581282.264948:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+12:15098:x1875463014284032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581282.264959:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581282.264972:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821ce400/0xf54e3944c2a71104 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a710fd expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581282.264993:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821ce400/0xf54e3944c2a71104 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a710fd expref: 13 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581282.265003:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821ce400/0xf54e3944c2a71104 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a710fd expref: 13 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581282.265012:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce400, rc 0) 00000100:00100000:3.0:1788581282.265103:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+13:15098:x1875463014284032:12345-0@lo:101:mount.lustre.0 Request processed in 158us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581282.265132:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014284032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581282.265144:0:15098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a710fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71104 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.265153:0:15098:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a710fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a71104 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581282.265170:0:15098:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788581282.265181:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a710fd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71104 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.265189:0:15098:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919044ca8e00/0xf54e3944c2a710fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71104 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581282.265194:0:15098:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788581282.265198:0:15098:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788581282.265202:0:15098:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788581282.265204:0:15098:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788581282.265217:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca8c00/0xf54e3944c2a7110b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.265224:0:15098:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919044ca8c00/0xf54e3944c2a7110b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.265232:0:15098:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919044ca8c00/0xf54e3944c2a7110b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581282.265273:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014284160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788581282.265299:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581282.265313:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907b909900 going to sleep for 11 seconds 00000100:00100000:3.0:1788581282.265370:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788581282.265392:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014284160 00000100:00100000:3.0:1788581282.265396:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014284160 00000100:00100000:3.0:1788581282.265412:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788581282.265417:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+13:15098:x1875463014284160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581282.265424:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581282.265432:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821cec00/0xf54e3944c2a71112 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a7110b expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581282.265445:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821cec00/0xf54e3944c2a71112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a7110b expref: 14 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581282.265452:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821cec00/0xf54e3944c2a71112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a7110b expref: 14 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581282.265458:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cec00, rc 0) 00000100:00100000:3.0:1788581282.265526:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+14:15098:x1875463014284160:12345-0@lo:101:mount.lustre.0 Request processed in 108us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581282.265532:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788581282.265580:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014284160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581282.265587:0:15098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919044ca8c00/0xf54e3944c2a7110b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71112 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.265592:0:15098:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919044ca8c00/0xf54e3944c2a7110b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a71112 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788581282.266542:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788581282.268632:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788581282.268938:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788581282.268983:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788581282.269016:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788581282.269078:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788581282.269111:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788581282.269143:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788581282.269611:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788581282.269622:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788581282.269717:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b912a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014284288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581282.269789:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581282.269838:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190467e5480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581282.269926:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014284288 00000100:00100000:2.0:1788581282.269933:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014284288 00000100:00100000:2.0:1788581282.270009:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788581282.270020:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+14:15098:x1875463014284288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581282.271957:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+14:15098:x1875463014284288:12345-0@lo:501:mount.lustre.0 Request processed in 1933us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581282.271970:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788581282.272127:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b912a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014284288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581282.272618:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b912a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014284416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581282.272678:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581282.272717:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048de0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581282.272859:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014284416 00000100:00100000:3.0:1788581282.272865:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014284416 00000100:00100000:3.0:1788581282.272901:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788581282.272910:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+14:15098:x1875463014284416:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788581282.273222:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+14:15098:x1875463014284416:12345-0@lo:503:mount.lustre.0 Request processed in 313us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581282.273230:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788581282.273364:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b912a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014284416:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788581282.275176:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788581282.275284:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014284544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581282.275383:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581282.275439:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048de0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581282.276843:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014284544 00000100:00100000:3.0:1788581282.276854:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014284544 00000100:00100000:3.0:1788581282.276908:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788581282.276917:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+14:15098:x1875463014284544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581282.277182:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+14:15098:x1875463014284544:12345-0@lo:502:mount.lustre.0 Request processed in 264us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581282.277190:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788581282.277593:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014284544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788581282.277858:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788581282.277915:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788581282.277942:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788581282.277978:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788581282.278006:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788581282.278046:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788581282.278085:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788581282.278113:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788581282.278137:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788581282.278189:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788581282.278218:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788581282.278301:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788581282.278347:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014284672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581282.278806:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581282.278906:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048de0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788581282.278954:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014284672 00000100:00100000:3.0:1788581282.278961:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014284672 00000100:00100000:3.0:1788581282.279039:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788581282.279047:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+14:15098:x1875463014284672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581282.279234:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+14:15098:x1875463014284672:12345-0@lo:502:mount.lustre.0 Request processed in 187us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581282.279262:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788581282.279344:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014284672:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788581282.279430:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788581282.279440:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788581282.280551:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788581282.280560:0:15112:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788581282.280566:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581282.280568:0:15112:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788581282.280573:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788581282.280587:0:15112:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff919075ed3370) 00000020:00000080:1.0:1788581282.280607:0:15112:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788581282.280613:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788581282.280679:0:15112:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919050d45000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788581282.280686:0:15112:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788581282.280692:0:15112:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf54e3944c2a71120 00010000:00010000:1.0:1788581282.285683:0:15112:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788581282.286591:0:15112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788581282.293918:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788581282.298749:0:15112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788581282.298766:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581282.298775:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581282.298777:0:15112:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788581282.298783:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788581282.298786:0:15112:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788581282.298787:0:15112:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788581282.298789:0:15112:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788581282.298790:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788581282.298793:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581282.298794:0:15112:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788581282.298797:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581282.298800:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581282.298802:0:15112:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788581282.298805:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788581282.298807:0:15112:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788581282.298810:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581282.298812:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581282.298813:0:15112:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788581282.298815:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581282.298817:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581282.298819:0:15112:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788581282.298822:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788581282.298891:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581282.298894:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581282.298896:0:15112:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788581282.298899:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788581282.299129:0:15098:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788581282.299159:0:15098:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788581282.299202:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca8c00/0xf54e3944c2a7110b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71112 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581282.299215:0:15098:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919044ca8c00/0xf54e3944c2a7110b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71112 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581282.299223:0:15098:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919050d45000 from 1 10000000:01000000:3.0:1788581282.299226:0:15098:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581282.299293:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a71127 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581282.299302:0:15098:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a71127 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581282.299324:0:15098:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a71127 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581282.299381:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014284800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788581282.299459:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581282.299502:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff919058f4e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581282.299725:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014284800 00000100:00100000:1.0:1788581282.299733:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014284800 00000100:00100000:1.0:1788581282.299777:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788581282.299786:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+14:15098:x1875463014284800:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581282.299807:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581282.299822:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919044ca8800/0xf54e3944c2a7112e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a71127 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.299845:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca8800/0xf54e3944c2a7112e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a71127 expref: 15 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.299855:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919044ca8800/0xf54e3944c2a7112e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a71127 expref: 15 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.299864:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8800, rc 0) 00000100:00100000:1.0:1788581282.299904:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+15:15098:x1875463014284800:12345-0@lo:101:mount.lustre.0 Request processed in 119us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581282.299910:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788581282.300520:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014284800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581282.300537:0:15098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a71127 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7112e expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581282.300545:0:15098:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a71127 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a7112e expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788581282.301877:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788581282.303879:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581282.307844:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788581282.307935:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788581282.308019:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788581282.308043:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788581282.308157:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014284928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581282.308275:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581282.308319:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff919058f4e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581282.308437:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014284928 00000100:00100000:0.0:1788581282.308445:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014284928 00000100:00100000:0.0:1788581282.308488:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788581282.308496:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+15:15098:x1875463014284928:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581282.308717:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+15:15098:x1875463014284928:12345-0@lo:501:mount.lustre.0 Request processed in 221us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581282.308724:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788581282.310980:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014284928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788581282.311042:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014285056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788581282.311110:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581282.311153:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff919058f4e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581282.315131:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014285056 00000100:00100000:1.0:1788581282.315150:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014285056 00000100:00100000:1.0:1788581282.315641:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788581282.315655:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+15:15098:x1875463014285056:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581282.315917:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+15:15098:x1875463014285056:12345-0@lo:503:mount.lustre.0 Request processed in 264us (4805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581282.315925:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788581282.316393:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014285056:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788581282.317044:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788581282.317127:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014285184:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581282.317208:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581282.317274:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190467e5780 going to sleep for 11 seconds 00000100:00100000:1.0:1788581282.319416:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014285184 00000100:00100000:1.0:1788581282.319430:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014285184 00000100:00100000:1.0:1788581282.319505:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788581282.319515:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+15:15098:x1875463014285184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581282.319779:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+15:15098:x1875463014285184:12345-0@lo:502:mount.lustre.0 Request processed in 264us (2570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581282.319796:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788581282.320095:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014285184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788581282.324655:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788581282.324752:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788581282.324807:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788581282.324863:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788581282.324917:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788581282.324965:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788581282.324999:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788581282.326702:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788581282.326773:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014285312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581282.326856:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581282.326903:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048de0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581282.327123:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014285312 00000100:00100000:0.0:1788581282.327131:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014285312 00000100:00100000:0.0:1788581282.327193:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788581282.327203:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+15:15098:x1875463014285312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581282.329548:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+15:15098:x1875463014285312:12345-0@lo:502:mount.lustre.0 Request processed in 2334us (2681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581282.329564:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788581282.329757:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014285312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788581282.329941:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788581282.329958:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788581282.332817:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581282.332830:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581282.332833:0:15116:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788581282.332841:0:15116:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff919050d45000 00000020:00000080:2.0:1788581282.332843:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788581282.332851:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581282.332853:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581282.332854:0:15116:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788581282.332857:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581282.332859:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581282.332861:0:15116:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788581282.332864:0:15116:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff919050d45000 00000020:00000080:2.0:1788581282.332866:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788581282.332933:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581282.332937:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581282.332938:0:15116:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788581282.332941:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581282.332944:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581282.332945:0:15116:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788581282.332949:0:15116:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff919050d45000 00000020:00000080:2.0:1788581282.332952:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788581282.333002:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581282.333006:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581282.333007:0:15116:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788581282.333011:0:15116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788581282.333767:0:15098:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788581282.333806:0:15098:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788581282.333829:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a71127 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7112e expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.333842:0:15098:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a71127 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7112e expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581282.333886:0:15098:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788581282.333889:0:15098:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff919050d45000 10000000:01000000:0.0:1788581282.333892:0:15098:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff919050d45000 10000000:01000000:0.0:1788581282.333897:0:15098:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788581282.333902:0:15098:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff919050d45000 from 1 10000000:01000000:0.0:1788581282.333904:0:15098:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788581282.333938:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bc22c00/0xf54e3944c2a71135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.333947:0:15098:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91907bc22c00/0xf54e3944c2a71135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.333968:0:15098:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91907bc22c00/0xf54e3944c2a71135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581282.333994:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014285440:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788581282.334081:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581282.334127:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190779736c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581282.334196:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014285440 00000100:00100000:1.0:1788581282.334204:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014285440 00000100:00100000:1.0:1788581282.334271:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788581282.334281:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+15:15098:x1875463014285440:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581282.334295:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581282.334306:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919044ca8200/0xf54e3944c2a7113c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a71135 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.334338:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca8200/0xf54e3944c2a7113c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a71135 expref: 16 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.334765:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919044ca8200/0xf54e3944c2a7113c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a71135 expref: 16 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.334777:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8200, rc 0) 00000100:00100000:1.0:1788581282.334831:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:15098:x1875463014285440:12345-0@lo:101:mount.lustre.0 Request processed in 551us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581282.334838:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788581282.334921:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014285440:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581282.334935:0:15098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91907bc22c00/0xf54e3944c2a71135 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7113c expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.334943:0:15098:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91907bc22c00/0xf54e3944c2a71135 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a7113c expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788581282.335758:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788581282.336052:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788581282.338551:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788581282.338635:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788581282.338673:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788581282.338719:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788581282.338756:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788581282.338804:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788581282.338841:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788581282.338875:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788581282.338922:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788581282.338981:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788581282.339017:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788581282.339081:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788581282.339118:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788581282.339151:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788581282.339226:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788581282.339297:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788581282.339325:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788581282.341641:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788581282.341722:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788581282.341757:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788581282.341820:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788581282.341859:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788581282.341891:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788581282.341940:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788581282.341976:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788581282.351900:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788581282.352064:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788581282.352107:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788581282.352202:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788581282.352211:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788581282.352358:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014285568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581282.352427:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581282.352472:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014285568 00000100:00100000:1.0:1788581282.352480:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014285568 00000100:00100000:1.0:1788581282.352540:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788581282.352548:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:15098:x1875463014285568:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581282.352778:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:15098:x1875463014285568:12345-0@lo:501:mount.lustre.0 Request processed in 230us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581282.352786:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788581282.352910:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076bd4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581282.352932:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014285568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581282.352962:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014285696:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581282.352997:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581282.353011:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076bd4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581282.353025:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014285696 00000100:00100000:1.0:1788581282.353029:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014285696 00000100:00100000:1.0:1788581282.353051:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788581282.353057:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:15098:x1875463014285696:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581282.353185:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:15098:x1875463014285696:12345-0@lo:503:mount.lustre.0 Request processed in 127us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581282.353192:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788581282.353230:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014285696:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788581282.353722:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581282.353780:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014285824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581282.353815:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581282.353841:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014285824 00000100:00100000:1.0:1788581282.353845:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014285824 00000100:00100000:1.0:1788581282.353868:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788581282.353874:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:15098:x1875463014285824:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581282.354035:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:15098:x1875463014285824:12345-0@lo:502:mount.lustre.0 Request processed in 161us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581282.354042:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788581282.354073:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076bd4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581282.354086:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014285824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788581282.354299:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788581282.354359:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788581282.354396:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788581282.354460:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788581282.354496:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788581282.354546:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788581282.354581:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788581282.354614:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788581282.354661:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788581282.354696:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788581282.354728:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788581282.354785:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788581282.354822:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788581282.354852:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788581282.354895:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788581282.354930:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788581282.354961:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788581282.355004:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788581282.355038:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788581282.355090:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788581282.355138:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788581282.355174:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788581282.355205:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788581282.355283:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788581282.355320:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788581282.365983:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788581282.366079:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788581282.366120:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788581282.366150:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788581282.366195:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788581282.366230:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788581282.366287:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788581282.366322:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788581282.366397:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788581282.366438:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788581282.366508:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788581282.366546:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788581282.366581:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788581282.366629:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788581282.366664:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788581282.366716:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014285952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581282.367904:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581282.367995:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076bd4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581282.370864:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014285952 00000100:00100000:0.0:1788581282.370880:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014285952 00000100:00100000:0.0:1788581282.371978:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788581282.371993:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:15098:x1875463014285952:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581282.372308:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:15098:x1875463014285952:12345-0@lo:502:mount.lustre.0 Request processed in 318us (4408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581282.372316:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788581282.373145:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014285952:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581282.373517:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788581282.373534:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788581282.374941:0:15121:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788581282.374968:0:15121:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff919066e499b8) 00000020:00000080:1.0:1788581282.374990:0:15121:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788581282.375066:0:15121:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919050d45000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788581282.375070:0:15121:0:(tgt_mount.c:187:server_put_mount()) put mount ffff919050d45000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788581282.375073:0:15121:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919050d45000 3 00010000:00080000:1.0:1788581282.375104:0:15121:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919066db9000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.113@tcp at head 00010000:00010000:1.0:1788581282.377344:0:15121:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788581282.377546:0:15121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788581282.377579:0:15121:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788581282.377593:0:15121:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf54e3944c2a7114a 00000100:00080000:1.0:1788581282.377603:0:15121:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788581282.377609:0:15121:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff919066db9000 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:1.0:1788581282.377652:0:15121:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907b97c700 x1875463014286080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788581282.377683:0:15121:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788581282.377713:0:12643:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581282.377717:0:12643:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581282.377720:0:12643:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581282.377723:0:12643:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788581282.377781:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3338:1875463014286208:0@lo:400:kworker.0 00000100:00100000:1.0:1788581282.377849:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581282.378040:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014286208 00000100:00100000:0.0:1788581282.378047:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014286208 00000100:00100000:0.0:1788581282.378088:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788581282.378097:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3338:x1875463014286208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581282.378159:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3338:x1875463014286208:12345-0@lo:400:kworker.0 Request processed in 63us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581282.378167:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788581282.379878:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91907b97ea00 x1875463014286208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581282.379896:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3338:1875463014286208:0@lo:400:kworker.0 00000100:00100000:2.0:1788581282.380233:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3337:1875463014286080:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788581282.381213:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788581282.381288:0:15098:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788581282.381312:0:15098:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788581282.381339:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91907bc22c00/0xf54e3944c2a71135 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7113c expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.381351:0:15098:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91907bc22c00/0xf54e3944c2a71135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7113c expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788581282.381397:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788581282.381400:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788581282.381402:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581282.381403:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581282.381405:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581282.381406:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581282.381408:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788581282.381409:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581282.381411:0:15098:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788581282.381415:0:15098:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788581282.381418:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788581282.381419:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788581282.381420:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581282.381421:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581282.381422:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581282.381423:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581282.381424:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788581282.381425:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581282.381426:0:15098:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788581282.381449:0:15098:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788581282.381466:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014286336:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788581282.381534:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581282.381568:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff919077973f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581282.381676:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014286336 00000100:00100000:3.0:1788581282.381683:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014286336 00000100:00100000:3.0:1788581282.381729:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788581282.381739:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:15098:x1875463014286336:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788581282.381765:0:14410:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788581282.381777:0:14410:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788581282.382221:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581282.382299:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014286080 00000100:00100000:2.0:1788581282.382304:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014286080 00000100:00100000:2.0:1788581282.382339:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581282.382345:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3337:x1875463014286080:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788581282.382366:0:14417:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:2.0:1788581282.382409:0:14417:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf54e3944c2a71151 00000004:00100000:2.0:1788581282.382422:0:14417:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788581282.382452:0:14417:0:(import.c:65:import_set_state_nolock()) ffff91906bea8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581282.382498:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3337:x1875463014286080:12345-0@lo:38:llog_process_th.0 Request processed in 152us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581282.382505:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788581282.382542:0:3337:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91907b97c700 x1875463014286080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581282.382554:0:3337:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788581282.382562:0:3337:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788581282.382568:0:3337:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788581282.382572:0:3337:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788581282.382575:0:3337:0:(import.c:65:import_set_state_nolock()) ffff919066db9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788581282.382581:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3337:1875463014286080:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788581282.408492:0:14410:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788581282.408513:0:14410:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788581282.408861:0:14432:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788581282.408867:0:14432:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788581282.408889:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919044ca9200/0xf54e3944c2a71158 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.408908:0:14432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a710be expref: 16 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.408916:0:14432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919044ca9200/0xf54e3944c2a71158 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.408957:0:14432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a710be expref: 16 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581282.408972:0:14432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a710be expref: 16 pid: 14410 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581282.409002:0:14432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14432:1875463014286464:0@lo:104: 00000100:00100000:1.0:1788581282.409070:0:14432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581282.409117:0:14432:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076bd4240 going to sleep for 11 seconds 00000100:00100000:0.0:1788581282.409230:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014286464 00000100:00100000:0.0:1788581282.409237:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014286464 00000100:00100000:0.0:1788581282.409306:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581282.409315:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+3:14432:x1875463014286464:12345-0@lo:104: 00010000:00010000:0.0:1788581282.409337:0:14401:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91906cb63800/0xf54e3944c2a710be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a710c5 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.409393:0:14401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581282.409399:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+3:14432:x1875463014286464:12345-0@lo:104: Request processed in 85us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581282.409406:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788581282.409426:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581282.409432:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91906cb63800/0xf54e3944c2a710be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a710c5 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.409438:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb63800 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:0.0:1788581282.409442:0:14406:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91906cb63800/0xf54e3944c2a710be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a710c5 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.409449:0:14406:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91906cb63800/0xf54e3944c2a710be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a710c5 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581282.409456:0:14406:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91906cb63800/0xf54e3944c2a710be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a710c5 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581282.409462:0:14406:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581282.409491:0:14406:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91906cb63800/0xf54e3944c2a710be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a710c5 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.409497:0:14406:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581282.409517:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91906cb63800/0xf54e3944c2a710be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a710c5 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.409535:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91906cb63800/0xf54e3944c2a710be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a710c5 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.409550:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581282.409552:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581282.409554:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581282.409567:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3339:1875463014286592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581282.409595:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581282.409637:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014286592 00000100:00100000:0.0:1788581282.409641:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014286592 00010000:00010000:0.0:1788581282.409659:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a710be expref: 17 pid: 14410 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581282.409681:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581282.409689:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b913800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:3339:x1875463014286592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581282.409699:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581282.409705:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a710be expref: 17 pid: 14410 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.409714:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a710be expref: 17 pid: 14410 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.409729:0:14404:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919044ca9200/0xf54e3944c2a71158 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.409735:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca9200/0xf54e3944c2a71158 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788581282.409810:0:14404:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000943921s 00010000:00010000:0.0:1788581282.409820:0:14404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919044ca9200/0xf54e3944c2a71158 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.409827:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919044ca9200/0xf54e3944c2a71158 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.409835:0:14404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919044ca9200/0xf54e3944c2a71158 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.409842:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919044ca9200/0xf54e3944c2a71158 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.409847:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9200 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581282.409850:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919044ca9200/0xf54e3944c2a71158 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.409857:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919044ca9200/0xf54e3944c2a71158 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.409865:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919044ca9200/0xf54e3944c2a71158 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.409873:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581282.409906:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b913800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:3339:x1875463014286592:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581282.409913:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581282.409949:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3339:1875463014286592:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581282.409974:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190821cee00/0xf54e3944c2a710c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a710be expref: 16 pid: 14410 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581282.409984:0:14432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14432:1875463014286464:0@lo:104: 00010000:00010000:0.0:1788581282.410002:0:14432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919044ca9200/0xf54e3944c2a71158 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.410010:0:14432:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919044ca9200/0xf54e3944c2a71158 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.410016:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919044ca9200/0xf54e3944c2a71158 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581282.410022:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919044ca9200/0xf54e3944c2a71158 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581282.419466:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+15:15098:x1875463014286336:12345-0@lo:253:mount.lustre.0 Request processed in 37719us (37922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581282.419482:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788581282.419578:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15098:1875463014286336:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788581282.419594:0:15098:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788581282.419597:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788581282.419599:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788581282.419600:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581282.419602:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581282.419603:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581282.419605:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581282.419607:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788581282.419608:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581282.419610:0:15098:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788581282.419627:0:15098:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788581282.423843:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788581282.424001:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788581282.424156:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788581282.424433:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788581282.424583:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788581282.424803:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788581282.426738:0:15098:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788581282.542060:0:15098:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788581282.542071:0:15098:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788581282.542107:0:15098:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788581282.542170:0:15098:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.113@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788581282.542184:0:15098:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788581282.542215:0:15098:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788581282.806019:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788581283.697470:0:14414:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788581283.697496:0:14414:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff919059822800 from 7 10000000:01000000:2.0:1788581283.697503:0:14414:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788581283.697553:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62e00/0xf54e3944c2a7115f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581283.697564:0:14414:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91906cb62e00/0xf54e3944c2a7115f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581283.697576:0:14414:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91906cb62e00/0xf54e3944c2a7115f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581283.697603:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014286720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788581283.697687:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581283.697757:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c5ee300 going to sleep for 11 seconds 00000100:00100000:0.0:1788581283.697875:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014286720 00000100:00100000:0.0:1788581283.697895:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014286720 00000100:00100000:0.0:1788581283.697966:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788581283.697978:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+15:14414:x1875463014286720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581283.697994:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581283.698011:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71166 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a7115f expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581283.698037:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a7115f expref: 16 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581283.698048:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a7115f expref: 16 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581283.698057:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91907bc22e00, rc 0) 00000100:00100000:0.0:1788581283.698111:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:14414:x1875463014286720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581283.698118:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788581283.698589:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014286720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581283.698610:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91906cb62e00/0xf54e3944c2a7115f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71166 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581283.698620:0:14414:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91906cb62e00/0xf54e3944c2a7115f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a71166 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581283.698690:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014286848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788581283.698739:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581283.698774:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c5ee300 going to sleep for 11 seconds 00000100:00100000:0.0:1788581283.698877:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014286848 00000100:00100000:0.0:1788581283.698883:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014286848 00000100:00100000:0.0:1788581283.698922:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788581283.698930:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:14414:x1875463014286848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788581283.698945:0:14410:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788581283.698960:0:14410:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788581283.698963:0:14410:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788581283.699047:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:14414:x1875463014286848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581283.699054:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788581283.699391:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014286848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788581283.699448:0:14414:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788581283.699456:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62e00/0xf54e3944c2a7115f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71166 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581283.699474:0:14414:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91906cb62e00/0xf54e3944c2a7115f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71166 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581283.829443:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581284.849464:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581285.876207:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581286.902808:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788581287.545512:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581287.545520:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788581287.545523:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581287.545526:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788581287.545662:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3340:1875463014286976:0@lo:400:kworker.0 00000100:00100000:1.0:1788581287.545734:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581287.545786:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581287.545793:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014287104:0@lo:400:kworker.0 00000100:00100000:1.0:1788581287.545827:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581287.545992:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014286976 00000100:00100000:1.0:1788581287.546000:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014286976 00000100:00100000:1.0:1788581287.546044:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788581287.546054:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:3340:x1875463014286976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581287.546103:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:3340:x1875463014286976:12345-0@lo:400:kworker.0 Request processed in 50us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581287.546153:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788581287.546262:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014287232:0@lo:400:kworker.0 00000100:00100000:0.0:1788581287.546300:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581287.546349:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014287104 00000100:00100000:0.0:1788581287.546353:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014287104 00000100:00100000:0.0:1788581287.546379:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014287232 00000100:00100000:0.0:1788581287.546382:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014287232 00000100:00100000:0.0:1788581287.546414:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581287.546420:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014287104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581287.546459:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014287104:12345-0@lo:400:kworker.0 Request processed in 39us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581287.546466:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581287.546482:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581287.546488:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014287232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581287.546520:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014287232:12345-0@lo:400:kworker.0 Request processed in 33us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581287.546526:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788581287.546565:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91907b97c000 x1875463014287232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581287.546579:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014287232:0@lo:400:kworker.0 00010000:00080000:1.0:1788581287.546721:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91907b97f800 x1875463014287104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581287.546731:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014287104:0@lo:400:kworker.0 00000100:00100000:1.0:1788581287.546740:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3340:1875463014286976:0@lo:400:kworker.0 00000100:00080000:2.0:1788581287.547137:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788581287.919862:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788581288.803589:0:15465:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788581288.944416:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788581289.403160:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788581289.970565:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581290.998179:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581292.015747:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788581292.657913:0:12643:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788581292.657923:0:12643:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788581292.657926:0:12643:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788581292.657930:0:12643:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788581292.658207:0:3337:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581277/real 1788581277] req@ffff9190768c8e00 x1875463014283008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581292 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581292.658266:0:3337:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9190768c8e00 x1875463014283008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581292 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581292.658278:0:3337:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788581277/real 1788581277] req@ffff9190768cb100 x1875463014283136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581292 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581292.658293:0:3337:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9190768cb100 x1875463014283136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788581292 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788581292.658317:0:3337:0:(import.c:65:import_set_state_nolock()) ffff919075ecc000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788581292.658328:0:3337:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788581292.658333:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014283008:0@lo:8:kworker.0 00000100:00080000:0.0:1788581292.658339:0:3337:0:(import.c:65:import_set_state_nolock()) ffff919075ecd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788581292.658344:0:3337:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788581292.658347:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014283136:0@lo:8:kworker.0 00000100:00100000:0.0:1788581292.658391:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3339:1875463014287360:0@lo:400:kworker.0 00000100:00100000:0.0:1788581292.658488:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788581292.659983:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581292.659993:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788581292.659997:0:38:0:(import.c:65:import_set_state_nolock()) ffff919075ecc000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581292.660006:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 493 00000100:00080000:2.0:1788581292.660012:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788581292.660021:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff919075ecc000 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:2.0:1788581292.660060:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9190768c9500 x1875463014287744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788581292.660083:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581292.660086:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788581292.660088:0:38:0:(import.c:65:import_set_state_nolock()) ffff919075ecd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581292.660091:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 493 00000100:00080000:2.0:1788581292.660094:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788581292.660097:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff919075ecd800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:2.0:1788581292.660108:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9190768c8380 x1875463014287872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581292.660977:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014287488:0@lo:400:kworker.0 00000100:00100000:1.0:1788581292.661071:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581292.661122:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581292.661129:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014287616:0@lo:400:kworker.0 00000100:00100000:1.0:1788581292.661169:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581292.661211:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014287360 00000100:00100000:1.0:1788581292.661220:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014287360 00000100:00100000:1.0:1788581292.661298:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788581292.661308:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:3339:x1875463014287360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581292.661366:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:3339:x1875463014287360:12345-0@lo:400:kworker.0 Request processed in 60us (2879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581292.661374:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788581292.661412:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014287488 00000100:00100000:1.0:1788581292.661417:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014287488 00000100:00100000:1.0:1788581292.661441:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014287616 00000100:00100000:1.0:1788581292.661444:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014287616 00000100:00100000:1.0:1788581292.661485:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788581292.661492:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014287488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581292.661529:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014287488:12345-0@lo:400:kworker.0 Request processed in 38us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581292.661554:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788581292.661567:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581292.661573:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014287616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581292.661614:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014287616:12345-0@lo:400:kworker.0 Request processed in 41us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581292.661620:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788581292.661649:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581292.661716:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3339:1875463014287360:0@lo:400:kworker.0 00010000:00080000:1.0:1788581292.661756:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91907b911180 x1875463014287616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581292.661768:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014287616:0@lo:400:kworker.0 00010000:00080000:1.0:1788581292.661778:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91907b912d80 x1875463014287488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581292.661785:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014287488:0@lo:400:kworker.0 00000100:00100000:0.0:1788581292.665981:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014287744:0@lo:8:kworker.0 00000100:00100000:0.0:1788581292.666087:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581292.666138:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014287872:0@lo:8:kworker.0 00000100:00100000:0.0:1788581292.666181:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581292.666881:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014287744 00000100:00100000:1.0:1788581292.666893:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014287744 00000100:00100000:1.0:1788581292.666927:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014287872 00000100:00100000:1.0:1788581292.666930:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014287872 00000100:00100000:1.0:1788581292.666945:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581292.666955:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3337:x1875463014287744:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788581292.666995:0:15099:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:1.0:1788581292.667036:0:15099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf54e3944c2a7116d 00002000:00100000:1.0:1788581292.667055:0:15099:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff919066db8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788581292.667060:0:15099:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788581292.667083:0:15099:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788581292.670164:0:15099:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788581292.671905:0:15099:0:(import.c:65:import_set_state_nolock()) ffff919066dbb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581292.672049:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3337:x1875463014287744:12345-0@lo:8:kworker.0 Request processed in 5090us (5958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581292.672065:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581292.672113:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581292.672121:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3337:x1875463014287872:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788581292.672145:0:15099:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788581292.672198:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3337:x1875463014287872:12345-0@lo:8:kworker.0 Request processed in 76us (6016us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788581292.672205:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788581292.672930:0:3337:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9190768c9500 x1875463014287744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581292.672946:0:3337:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788581292.672977:0:3337:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788581292.672989:0:3337:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788581292.672996:0:3337:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788581292.673001:0:3337:0:(import.c:65:import_set_state_nolock()) ffff919075ecc000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788581292.673029:0:3337:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788581292.673036:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014287744:0@lo:8:kworker.0 00000100:00080000:0.0:1788581292.673056:0:3337:0:(import.c:65:import_set_state_nolock()) ffff919075ecd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788581292.673062:0:3337:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788581292.673065:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014287872:0@lo:8:kworker.0 00000004:00080000:2.0:1788581292.673211:0:14439:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000004:00080000:1.0:1788581292.673317:0:14438:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788581292.673624:0:14439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14439:1875463014288128:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788581292.676978:0:14438:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 508917730626ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788581292.679333:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014288000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581292.681062:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581292.682653:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014288000 00000100:00100000:3.0:1788581292.682670:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014288000 00000100:00100000:3.0:1788581292.682769:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581292.682781:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014288000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581292.682833:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788581292.683050:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581292.683234:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3338:x1875463014288000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 453us (2176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581292.683271:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788581292.683339:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9190768c8000 x1875463014288000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581292.683370:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014288000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581292.690177:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581292.690265:0:14439:0:(client.c:2715:ptlrpc_set_wait()) set ffff919049984780 going to sleep for 11 seconds 00000100:00100000:0.0:1788581292.691774:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014288128 00000100:00100000:0.0:1788581292.691793:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014288128 00000100:00100000:0.0:1788581292.691867:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581292.691881:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14439:x1875463014288128:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788581292.697360:0:15100:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788581292.697375:0:15100:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788581292.697383:0:15100:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:0.0:1788581292.709782:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581292.709798:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71174 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.709820:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788581292.709826:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581292.709834:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71174 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.709865:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71174 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.709879:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71174 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.709888:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71174 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.709921:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581292.709947:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581292.709954:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71174 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.709962:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.709968:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71174 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.709978:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71174 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.709998:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71174 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.710005:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71174 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.710035:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.710037:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.710039:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581292.710690:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581292.710698:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a7117b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.710709:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788581292.710713:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581292.710719:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a7117b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.710729:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a7117b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.710738:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a7117b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.710745:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a7117b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.710766:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581292.713773:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581292.713789:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a7117b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.713805:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22200 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:2.0:1788581292.713811:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a7117b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.713823:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a7117b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.713855:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a7117b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.713865:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a7117b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.713894:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581292.713896:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581292.713898:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581292.714140:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581292.714150:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a71182 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.714206:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788581292.714212:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581292.714219:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a71182 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.714232:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a71182 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.714272:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a71182 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.714281:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a71182 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.714352:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788581292.715068:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581292.715076:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a71189 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.715087:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788581292.715091:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581292.715096:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a71189 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.715107:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a71189 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.715128:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a71189 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.715137:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a71189 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.720309:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581292.720331:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a71182 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.720349:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581292.720355:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a71182 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.720369:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a71182 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.720401:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a71182 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.720429:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a71182 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.720456:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581292.720460:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a71189 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.720468:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23200 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581292.720480:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a71189 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.720804:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a71189 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.720816:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a71189 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.720825:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581292.720827:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581292.720829:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.721292:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788581292.721303:0:15100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a71189 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.721812:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581292.723169:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581292.723192:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71190 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.723212:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788581292.723218:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581292.723226:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71190 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.723269:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71190 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.723281:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71190 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.723303:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71190 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.723326:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788581292.723861:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581292.723869:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a71197 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.723879:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788581292.723883:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581292.723887:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a71197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.723896:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a71197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.723906:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a71197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.723928:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a71197 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.723952:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788581292.723968:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581292.723974:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71190 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.723990:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.723994:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71190 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724003:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71190 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724023:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71190 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724030:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a71190 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724049:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581292.724053:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a71197 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724060:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23000 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.724063:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a71197 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724071:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a71197 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724080:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a71197 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724093:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a71197 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724107:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.724109:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.724111:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581292.724590:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581292.724598:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f82949dd/0xf54e3944c2a7119e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724607:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788581292.724611:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581292.724615:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f82949dd/0xf54e3944c2a7119e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724625:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f82949dd/0xf54e3944c2a7119e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724632:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f82949dd/0xf54e3944c2a7119e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724639:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f82949dd/0xf54e3944c2a7119e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724658:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581292.724668:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581292.724678:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f82949dd/0xf54e3944c2a7119e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724685:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23c00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.724689:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f82949dd/0xf54e3944c2a7119e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724697:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f82949dd/0xf54e3944c2a7119e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724709:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f82949dd/0xf54e3944c2a7119e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724716:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f82949dd/0xf54e3944c2a7119e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.724730:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.724732:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.724734:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581292.725139:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581292.725145:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a711a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725168:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788581292.725172:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581292.725176:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a711a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725197:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a711a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725216:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a711a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725223:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a711a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725238:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581292.725272:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581292.725276:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a711a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725283:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22600 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.725286:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a711a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725294:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a711a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725304:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a711a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725311:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003678ecdb/0xf54e3944c2a711a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725333:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.725335:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.725337:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581292.725746:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581292.725753:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a711ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725761:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788581292.725764:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581292.725769:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a711ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725779:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a711ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725788:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a711ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725796:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a711ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725814:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581292.725822:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581292.725826:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a711ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725844:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22400 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.725848:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a711ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725856:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a711ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725868:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a711ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725875:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000581b1e2b/0xf54e3944c2a711ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.725889:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.725891:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.725892:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581292.727194:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581292.730188:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581292.730208:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a042fd68/0xf54e3944c2a711b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.730233:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788581292.730239:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581292.730272:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a042fd68/0xf54e3944c2a711b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.730290:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a042fd68/0xf54e3944c2a711b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.730310:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a042fd68/0xf54e3944c2a711b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.730318:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a042fd68/0xf54e3944c2a711b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.730343:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788581292.731052:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581292.731061:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd8d3873/0xf54e3944c2a711ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.731073:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788581292.731077:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581292.731081:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd8d3873/0xf54e3944c2a711ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.731091:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd8d3873/0xf54e3944c2a711ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.731099:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd8d3873/0xf54e3944c2a711ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.731107:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd8d3873/0xf54e3944c2a711ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.731144:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788581292.731184:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581292.731192:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a042fd68/0xf54e3944c2a711b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.731201:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23e00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.731207:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a042fd68/0xf54e3944c2a711b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.731218:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a042fd68/0xf54e3944c2a711b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.731240:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a042fd68/0xf54e3944c2a711b3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.731278:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a042fd68/0xf54e3944c2a711b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.731302:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581292.731306:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd8d3873/0xf54e3944c2a711ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.731312:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23600 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.731315:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd8d3873/0xf54e3944c2a711ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.731334:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd8d3873/0xf54e3944c2a711ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.731346:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd8d3873/0xf54e3944c2a711ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.731354:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd8d3873/0xf54e3944c2a711ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.731367:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.731369:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.731371:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581292.732124:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581292.734936:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581292.734956:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a711c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.734978:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788581292.734984:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581292.734992:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a711c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.735009:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a711c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.735022:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a711c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.735042:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a711c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.735078:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581292.735977:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581292.735990:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a711c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.736016:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22200 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581292.736022:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a711c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.736031:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a711c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.736056:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a711c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.736063:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cb5b2d7/0xf54e3944c2a711c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.736086:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581292.736088:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581292.736090:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581292.737758:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581292.737773:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a711c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.737792:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788581292.737797:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581292.737803:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a711c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.737818:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a711c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.737831:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a711c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.737840:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a711c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.737876:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788581292.738392:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581292.738400:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a711cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.738417:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788581292.738420:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581292.738426:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a711cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.738437:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a711cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.738446:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a711cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.738453:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a711cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.738477:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788581292.738497:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581292.738504:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a711c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.738512:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23000 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.738517:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a711c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.738526:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a711c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.738558:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a711c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.738566:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6012c05/0xf54e3944c2a711c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.738588:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581292.738591:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a711cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.738597:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc22800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.738600:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a711cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.738607:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a711cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.738617:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a711cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.738623:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f0d6034/0xf54e3944c2a711cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.738636:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.738638:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.738645:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581292.739071:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581292.739078:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a711d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739087:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788581292.739090:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581292.739095:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a711d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739105:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a711d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739113:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a711d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739120:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a711d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739138:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581292.739147:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581292.739166:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a711d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739174:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23200 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.739177:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a711d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739196:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a711d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739208:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a711d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739215:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058b6f382/0xf54e3944c2a711d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739229:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.739231:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.739233:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581292.739666:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581292.739672:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a711dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739680:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788581292.739684:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581292.739688:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a711dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739697:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a711dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739704:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a711dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739718:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a711dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739736:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581292.739745:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581292.739748:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a711dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739755:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91907bc23800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.739758:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a711dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739765:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a711dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739776:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a711dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739783:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000480544c6/0xf54e3944c2a711dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.739796:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.739798:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.739799:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581292.740701:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788581292.743327:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788581292.743354:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000021edfa7/0xf54e3944c2a711e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.743376:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788581292.743382:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581292.743390:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000021edfa7/0xf54e3944c2a711e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.743407:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000021edfa7/0xf54e3944c2a711e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.743420:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000021edfa7/0xf54e3944c2a711e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.743429:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000021edfa7/0xf54e3944c2a711e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.743453:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581292.743579:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581292.743589:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000021edfa7/0xf54e3944c2a711e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.743605:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919075b7da00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581292.743610:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000021edfa7/0xf54e3944c2a711e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.743620:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000021edfa7/0xf54e3944c2a711e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.743649:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000021edfa7/0xf54e3944c2a711e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.743656:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000021edfa7/0xf54e3944c2a711e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581292.743679:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581292.743681:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581292.743684:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581292.752636:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788581292.752655:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c40faa4/0xf54e3944c2a711eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.752691:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1788581292.752861:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581292.752871:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c40faa4/0xf54e3944c2a711eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.752892:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c40faa4/0xf54e3944c2a711eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.752906:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c40faa4/0xf54e3944c2a711eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.752916:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c40faa4/0xf54e3944c2a711eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.752948:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788581292.753534:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788581292.753542:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fb2f366/0xf54e3944c2a711f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.753553:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1788581292.753557:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581292.753562:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fb2f366/0xf54e3944c2a711f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.753572:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fb2f366/0xf54e3944c2a711f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.753828:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581292.753839:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c40faa4/0xf54e3944c2a711eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.753849:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb63800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.753854:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c40faa4/0xf54e3944c2a711eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.753864:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c40faa4/0xf54e3944c2a711eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.753896:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c40faa4/0xf54e3944c2a711eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.753904:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c40faa4/0xf54e3944c2a711eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.753928:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.753930:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.753933:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581292.755032:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fb2f366/0xf54e3944c2a711f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.755057:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fb2f366/0xf54e3944c2a711f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.755086:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581292.755757:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581292.755766:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fb2f366/0xf54e3944c2a711f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.755778:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb63400 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581292.755790:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fb2f366/0xf54e3944c2a711f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.755802:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fb2f366/0xf54e3944c2a711f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.755825:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fb2f366/0xf54e3944c2a711f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.755833:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fb2f366/0xf54e3944c2a711f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.755856:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581292.755859:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581292.755861:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788581292.757266:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788581292.757281:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004928bd17/0xf54e3944c2a711f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.757301:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=508s v=(0 0) 00010000:00010000:2.0:1788581292.757306:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581292.757313:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004928bd17/0xf54e3944c2a711f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.757326:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004928bd17/0xf54e3944c2a711f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.757335:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004928bd17/0xf54e3944c2a711f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.757343:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004928bd17/0xf54e3944c2a711f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.757383:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581292.758452:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581292.758468:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004928bd17/0xf54e3944c2a711f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.758494:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb63a00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581292.758499:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004928bd17/0xf54e3944c2a711f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.758511:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004928bd17/0xf54e3944c2a711f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.758534:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004928bd17/0xf54e3944c2a711f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.758553:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004928bd17/0xf54e3944c2a711f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.758580:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581292.758582:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581292.758584:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581292.761780:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581292.761800:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc62cf60/0xf54e3944c2a71200 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.761822:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788581292.761829:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581292.761837:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc62cf60/0xf54e3944c2a71200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.761859:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc62cf60/0xf54e3944c2a71200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.761872:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc62cf60/0xf54e3944c2a71200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.761881:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc62cf60/0xf54e3944c2a71200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.761908:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788581292.762581:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581292.762593:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc62cf60/0xf54e3944c2a71200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.762614:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf000 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:2.0:1788581292.762620:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc62cf60/0xf54e3944c2a71200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.762632:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc62cf60/0xf54e3944c2a71200 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.762655:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc62cf60/0xf54e3944c2a71200 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.762663:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc62cf60/0xf54e3944c2a71200 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581292.762686:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581292.762688:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581292.762691:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581292.767343:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581292.767371:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009edfae12/0xf54e3944c2a71207 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.767397:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788581292.767403:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581292.767412:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009edfae12/0xf54e3944c2a71207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.767430:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009edfae12/0xf54e3944c2a71207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.767444:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009edfae12/0xf54e3944c2a71207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.767453:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009edfae12/0xf54e3944c2a71207 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.767481:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581292.768142:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581292.768163:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009edfae12/0xf54e3944c2a71207 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.768847:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.768853:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009edfae12/0xf54e3944c2a71207 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.768867:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009edfae12/0xf54e3944c2a71207 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.768895:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009edfae12/0xf54e3944c2a71207 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.768903:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009edfae12/0xf54e3944c2a71207 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.768945:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.768948:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.768950:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581292.769788:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581292.769800:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fed1a3/0xf54e3944c2a7120e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.769815:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788581292.769819:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581292.769826:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fed1a3/0xf54e3944c2a7120e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.769839:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fed1a3/0xf54e3944c2a7120e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.769857:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fed1a3/0xf54e3944c2a7120e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.769865:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fed1a3/0xf54e3944c2a7120e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.769893:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581292.770983:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581292.770996:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fed1a3/0xf54e3944c2a7120e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.771009:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.771015:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fed1a3/0xf54e3944c2a7120e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.771025:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fed1a3/0xf54e3944c2a7120e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.771045:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fed1a3/0xf54e3944c2a7120e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.771053:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fed1a3/0xf54e3944c2a7120e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.771075:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.771077:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.771079:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581292.771115:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581292.771123:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faf36045/0xf54e3944c2a71215 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.771134:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788581292.771138:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581292.771143:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faf36045/0xf54e3944c2a71215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.771163:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faf36045/0xf54e3944c2a71215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.771179:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faf36045/0xf54e3944c2a71215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.771187:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000faf36045/0xf54e3944c2a71215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.771226:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788581292.771614:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581292.771621:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000faf36045/0xf54e3944c2a71215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.771643:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce000 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.771647:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000faf36045/0xf54e3944c2a71215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.771656:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000faf36045/0xf54e3944c2a71215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.771667:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000faf36045/0xf54e3944c2a71215 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.771675:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faf36045/0xf54e3944c2a71215 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.771691:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.771704:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.771706:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581292.772280:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581292.772288:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d834673/0xf54e3944c2a7121c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.772301:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788581292.772306:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581292.772312:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d834673/0xf54e3944c2a7121c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.772325:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d834673/0xf54e3944c2a7121c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.772334:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d834673/0xf54e3944c2a7121c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.772343:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d834673/0xf54e3944c2a7121c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.772368:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788581292.773051:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581292.773059:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c6400ea/0xf54e3944c2a71223 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.773070:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788581292.773081:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581292.773087:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c6400ea/0xf54e3944c2a71223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.773098:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c6400ea/0xf54e3944c2a71223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.773106:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c6400ea/0xf54e3944c2a71223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.773114:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c6400ea/0xf54e3944c2a71223 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.773132:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788581292.773596:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581292.773603:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b01b63a/0xf54e3944c2a7122a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.773613:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788581292.773617:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581292.773621:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b01b63a/0xf54e3944c2a7122a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.773631:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b01b63a/0xf54e3944c2a7122a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.773639:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b01b63a/0xf54e3944c2a7122a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.773653:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b01b63a/0xf54e3944c2a7122a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581292.773663:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788581292.774284:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788581292.774295:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d834673/0xf54e3944c2a7121c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.774306:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf400 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.774311:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d834673/0xf54e3944c2a7121c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.774322:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d834673/0xf54e3944c2a7121c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.774379:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d834673/0xf54e3944c2a7121c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.774389:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d834673/0xf54e3944c2a7121c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.774412:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581292.774416:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c6400ea/0xf54e3944c2a71223 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.774424:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cfa00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.774428:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c6400ea/0xf54e3944c2a71223 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.774435:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c6400ea/0xf54e3944c2a71223 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.774445:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c6400ea/0xf54e3944c2a71223 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.774452:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c6400ea/0xf54e3944c2a71223 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.774464:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581292.774468:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b01b63a/0xf54e3944c2a7122a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.774492:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce600 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581292.774497:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b01b63a/0xf54e3944c2a7122a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.774505:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b01b63a/0xf54e3944c2a7122a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.774517:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b01b63a/0xf54e3944c2a7122a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.774525:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b01b63a/0xf54e3944c2a7122a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581292.774542:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.774544:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.774546:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581292.774555:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788581292.775115:0:15100:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1788581292.776163:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14439:x1875463014288128:12345-0@lo:5:osp-pre-0-0.0 Request processed in 84266us (85991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581292.776681:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581292.776823:0:14439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14439:1875463014288128:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788581292.776843:0:14439:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788581292.776909:0:14439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14439:1875463014288256:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788581292.776958:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581292.777022:0:14439:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c5eec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581292.777081:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014288256 00000100:00100000:2.0:1788581292.777091:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014288256 00000100:00100000:2.0:1788581292.777160:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581292.777179:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14439:x1875463014288256:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788581292.777262:0:15099:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:2.0:1788581292.788636:0:5899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788581292.792142:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14439:x1875463014288256:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14958us (15168us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788581292.792178:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581292.792514:0:14439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14439:1875463014288256:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788581292.792540:0:14439:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1788581293.041288:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581294.063501:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581295.087463:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581296.111402:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788581296.385715:0:15816:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788581296.385719:0:15816:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788581296.386238:0:15816:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91906be86000 00000020:01000004:0.0:1788581296.386348:0:15816:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788581296.386361:0:15816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788581296.386386:0:15816:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff919047c98000) 00000020:00000080:0.0:1788581296.386404:0:15816:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788581296.412142:0:15816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788581296.413888:0:15816:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788581296.415023:0:15816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788581296.417199:0:15816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788581296.417926:0:15816:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788581296.418718:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 473: rc = 0 00100000:10000000:0.0:1788581296.418903:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 473: rc = 0 00100000:10000000:0.0:1788581296.419010:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 473: rc = 0 00100000:10000000:3.0:1788581296.424019:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 516: rc = 0 00100000:10000000:0.0:1788581296.426027:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 516: rc = 0 00100000:10000000:2.0:1788581296.426731:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 516: rc = 0 00100000:10000000:2.0:1788581296.427104:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 516: rc = 0 00100000:10000000:2.0:1788581296.427634:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 516: rc = 0 00100000:10000000:2.0:1788581296.427984:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 516: rc = 0 00000020:00000080:2.0:1788581296.428919:0:15816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788581296.428936:0:15816:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788581296.428949:0:15816:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf54e3944c2a71238 00000020:01000004:2.0:1788581296.428957:0:15816:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788581296.428979:0:15816:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.113@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788581296.428982:0:15816:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788581296.428989:0:15816:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788581296.429012:0:15816:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788581296.429019:0:15816:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788581296.446783:0:15816:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788581296.446819:0:15816:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.113@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788581296.446823:0:15816:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788581296.446824:0:15816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788581296.446835:0:15816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581296.446836:0:15816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581296.446837:0:15816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581296.446838:0:15816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581296.446840:0:15816:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788581296.446842:0:15816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581296.446843:0:15816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788581296.446847:0:15816:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788581296.446849:0:15816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788581296.446850:0:15816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788581296.446852:0:15816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581296.446853:0:15816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581296.446854:0:15816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581296.446855:0:15816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581296.446861:0:15816:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788581296.446862:0:15816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581296.446863:0:15816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788581296.446886:0:15816:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788581296.446905:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014288384:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788581296.446978:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581296.447037:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190472fa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581296.447599:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014288384 00000100:00100000:1.0:1788581296.447607:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014288384 00000100:00100000:1.0:1788581296.447663:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788581296.447672:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:15816:x1875463014288384:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788581296.447699:0:14411:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788581296.447703:0:14411:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788581296.447707:0:14411:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788581296.459607:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:15816:x1875463014288384:12345-0@lo:253:mount.lustre.0 Request processed in 11927us (12619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581296.459624:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788581296.459796:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014288384:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788581296.459813:0:15816:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788581296.459816:0:15816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788581296.459818:0:15816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788581296.459819:0:15816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581296.459832:0:15816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581296.459833:0:15816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581296.459835:0:15816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581296.459836:0:15816:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788581296.459838:0:15816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581296.459853:0:15816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788581296.459875:0:15816:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91906be86000 from lustre-OST0001 10000000:01000000:0.0:1788581296.459902:0:15816:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788581296.459904:0:15816:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788581296.459912:0:15816:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff919076213370 local copy 00010000:00010000:0.0:1788581296.459924:0:15816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62c00/0xf54e3944c2a70fe5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70fec expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581296.460296:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014288512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581296.460336:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581296.460367:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076bd4540 going to sleep for 11 seconds 00000100:00100000:2.0:1788581296.460612:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014288512 00000100:00100000:2.0:1788581296.460620:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014288512 00000100:00100000:2.0:1788581296.460669:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788581296.460680:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:15816:x1875463014288512:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581296.460860:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:15816:x1875463014288512:12345-0@lo:501:mount.lustre.0 Request processed in 181us (523us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581296.460868:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788581296.461044:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014288512:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788581296.461058:0:15816:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788581296.461225:0:15816:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788581296.461234:0:15816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62c00/0xf54e3944c2a70fe5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70fec expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581296.461283:0:15816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91906cb62c00/0xf54e3944c2a70fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a70fec expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581296.461305:0:15816:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91906be86000 10000000:01000000:0.0:1788581296.461310:0:15816:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788581296.461314:0:15816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788581296.461317:0:15816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788581296.461322:0:15816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788581296.461325:0:15816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788581296.461348:0:15816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919075b7de00/0xf54e3944c2a7123f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581296.461356:0:15816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919075b7de00/0xf54e3944c2a7123f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581296.461384:0:15816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919075b7de00/0xf54e3944c2a7123f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581296.461399:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014288640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788581296.461429:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581296.461453:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076bd4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788581296.461545:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014288640 00000100:00100000:3.0:1788581296.461550:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014288640 00000100:00100000:3.0:1788581296.461579:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788581296.461586:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:15816:x1875463014288640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788581296.461595:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581296.461608:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821ce600/0xf54e3944c2a71246 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a7123f expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581296.461629:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821ce600/0xf54e3944c2a71246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a7123f expref: 17 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581296.461640:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821ce600/0xf54e3944c2a71246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a7123f expref: 17 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581296.461648:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce600, rc 0) 00000100:00100000:3.0:1788581296.461679:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:15816:x1875463014288640:12345-0@lo:101:mount.lustre.0 Request processed in 94us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581296.461686:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788581296.461975:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014288640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788581296.461987:0:15816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919075b7de00/0xf54e3944c2a7123f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71246 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581296.461996:0:15816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919075b7de00/0xf54e3944c2a7123f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a71246 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788581296.462979:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788581296.467739:0:15816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788581296.468180:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788581296.468229:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788581296.468297:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788581296.468923:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788581296.468978:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788581296.469016:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788581296.469102:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788581296.469111:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788581296.469211:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014288768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581296.470226:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581296.470433:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076bd4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581296.470493:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014288768 00000100:00100000:1.0:1788581296.470502:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014288768 00000100:00100000:1.0:1788581296.470704:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788581296.470715:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:15816:x1875463014288768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581296.471127:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:15816:x1875463014288768:12345-0@lo:501:mount.lustre.0 Request processed in 413us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581296.471136:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788581296.471213:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014288768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581296.471302:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014288896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788581296.471344:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581296.483120:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076bd4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581296.483222:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014288896 00000100:00100000:3.0:1788581296.483233:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014288896 00000100:00100000:3.0:1788581296.483330:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788581296.483340:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:15816:x1875463014288896:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788581296.483781:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:15816:x1875463014288896:12345-0@lo:503:mount.lustre.0 Request processed in 441us (12434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581296.483789:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788581296.484798:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014288896:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788581296.485499:0:15816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788581296.485664:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014289024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581296.485735:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581296.485772:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076bd4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581296.486098:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014289024 00000100:00100000:3.0:1788581296.486106:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014289024 00000100:00100000:3.0:1788581296.486143:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788581296.486153:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:15816:x1875463014289024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581296.486438:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:15816:x1875463014289024:12345-0@lo:502:mount.lustre.0 Request processed in 286us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581296.486447:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788581296.486874:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014289024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581296.487158:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788581296.487214:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788581296.487271:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788581296.487322:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788581296.487436:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788581296.487480:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788581296.487672:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788581296.487709:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788581296.487886:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788581296.487928:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014289152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581296.487988:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581296.488140:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076bd4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581296.488336:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014289152 00000100:00100000:1.0:1788581296.488346:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014289152 00000100:00100000:1.0:1788581296.488398:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788581296.488416:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:15816:x1875463014289152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788581296.488632:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:15816:x1875463014289152:12345-0@lo:502:mount.lustre.0 Request processed in 216us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581296.488639:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788581296.488837:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014289152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581296.488928:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788581296.488939:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788581296.491238:0:15817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788581296.491271:0:15817:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788581296.491287:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581296.491290:0:15817:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788581296.491295:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788581296.491309:0:15817:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff919047c9cd28) 00000020:00000080:0.0:1788581296.491331:0:15817:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788581296.491336:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788581296.491499:0:15817:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91906be86000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788581296.491616:0:15817:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788581296.491623:0:15817:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf54e3944c2a71254 00010000:00010000:0.0:1788581296.499063:0:15817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1788581296.499788:0:15817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1788581296.502860:0:15817:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788581296.504472:0:15817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788581296.504484:0:15817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581296.504489:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581296.504491:0:15817:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788581296.504496:0:15817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581296.505171:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581296.505176:0:15817:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788581296.505183:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788581296.505184:0:15817:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788581296.505187:0:15817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581296.505189:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581296.505190:0:15817:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788581296.505193:0:15817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581296.505195:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581296.505196:0:15817:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788581296.505199:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788581296.505311:0:15817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581296.505315:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581296.505317:0:15817:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788581296.505319:0:15817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788581296.506632:0:15816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788581296.506667:0:15816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788581296.506687:0:15816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919075b7de00/0xf54e3944c2a7123f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71246 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.506700:0:15816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919075b7de00/0xf54e3944c2a7123f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71246 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581296.506707:0:15816:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91906be86000 from 1 10000000:01000000:1.0:1788581296.506710:0:15816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788581296.506745:0:15816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca9800/0xf54e3944c2a7125b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.506751:0:15816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919044ca9800/0xf54e3944c2a7125b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.506762:0:15816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919044ca9800/0xf54e3944c2a7125b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581296.506787:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014289280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788581296.506849:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581296.506886:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff919077973cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581296.506911:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014289280 00000100:00100000:1.0:1788581296.506918:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014289280 00000100:00100000:1.0:1788581296.506961:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788581296.506980:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:15816:x1875463014289280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581296.506993:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581296.507004:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a71262 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a7125b expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.507027:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a71262 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a7125b expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.507037:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a71262 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a7125b expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.507045:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9c00, rc 0) 00000100:00100000:1.0:1788581296.507082:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:15816:x1875463014289280:12345-0@lo:101:mount.lustre.0 Request processed in 104us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581296.507099:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788581296.507145:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014289280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581296.507159:0:15816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919044ca9800/0xf54e3944c2a7125b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71262 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.507168:0:15816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919044ca9800/0xf54e3944c2a7125b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a71262 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581296.510068:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788581296.512227:0:15816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581296.515115:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788581296.515176:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788581296.515278:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788581296.515289:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788581296.517637:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014289408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581296.518032:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581296.518083:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff919077973cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581296.518237:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014289408 00000100:00100000:0.0:1788581296.518266:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014289408 00000100:00100000:0.0:1788581296.518315:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788581296.518325:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:15816:x1875463014289408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788581296.518701:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:15816:x1875463014289408:12345-0@lo:501:mount.lustre.0 Request processed in 376us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581296.518708:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788581296.521789:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014289408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581296.521853:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014289536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788581296.521933:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581296.521979:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff919077973cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581296.525639:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014289536 00000100:00100000:3.0:1788581296.525655:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014289536 00000100:00100000:3.0:1788581296.525716:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788581296.525726:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:15816:x1875463014289536:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788581296.530400:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:15816:x1875463014289536:12345-0@lo:503:mount.lustre.0 Request processed in 4661us (8453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581296.530421:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788581296.532410:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014289536:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788581296.532977:0:15816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788581296.533062:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014289664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581296.533151:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581296.533193:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076bd4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581296.533859:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014289664 00000100:00100000:2.0:1788581296.533868:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014289664 00000100:00100000:2.0:1788581296.533920:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788581296.533929:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f91b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:15816:x1875463014289664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581296.534177:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f91b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:15816:x1875463014289664:12345-0@lo:502:mount.lustre.0 Request processed in 248us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581296.534185:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788581296.534407:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014289664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581296.534858:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788581296.534914:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788581296.534988:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788581296.535030:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788581296.535066:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788581296.535141:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788581296.535178:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788581296.535212:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788581296.535290:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014289792:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581296.535346:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581296.535728:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076bd4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581296.535925:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014289792 00000100:00100000:3.0:1788581296.535932:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014289792 00000100:00100000:3.0:1788581296.536009:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788581296.536019:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f919850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:15816:x1875463014289792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581296.536222:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f919850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:15816:x1875463014289792:12345-0@lo:502:mount.lustre.0 Request processed in 203us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581296.536230:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788581296.536350:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014289792:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788581296.536462:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788581296.536473:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788581296.539187:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581296.539212:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581296.539215:0:15821:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788581296.539224:0:15821:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91906be86000 00000020:00000080:0.0:1788581296.539226:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788581296.539233:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581296.539236:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581296.539237:0:15821:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788581296.539239:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581296.539263:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581296.539265:0:15821:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788581296.539269:0:15821:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91906be86000 00000020:00000080:0.0:1788581296.539271:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788581296.539334:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581296.539338:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581296.539340:0:15821:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788581296.539342:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581296.539345:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581296.539346:0:15821:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788581296.539350:0:15821:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91906be86000 00000020:00000080:0.0:1788581296.539352:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788581296.539660:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581296.539664:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581296.539666:0:15821:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788581296.539669:0:15821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788581296.542448:0:15816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788581296.542487:0:15816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581296.543603:0:15816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca9800/0xf54e3944c2a7125b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71262 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.543619:0:15816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919044ca9800/0xf54e3944c2a7125b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71262 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581296.543679:0:15816:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788581296.543682:0:15816:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91906be86000 10000000:01000000:1.0:1788581296.543686:0:15816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91906be86000 10000000:01000000:1.0:1788581296.543690:0:15816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788581296.543696:0:15816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91906be86000 from 1 10000000:01000000:1.0:1788581296.543699:0:15816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788581296.543737:0:15816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca9e00/0xf54e3944c2a71269 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.543746:0:15816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff919044ca9e00/0xf54e3944c2a71269 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.543757:0:15816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff919044ca9e00/0xf54e3944c2a71269 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581296.543795:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014289920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788581296.543865:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581296.543909:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff919077973480 going to sleep for 11 seconds 00000100:00100000:1.0:1788581296.546526:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014289920 00000100:00100000:1.0:1788581296.546543:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014289920 00000100:00100000:1.0:1788581296.546604:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788581296.546616:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:15816:x1875463014289920:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581296.546631:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581296.546650:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919044ca8600/0xf54e3944c2a71270 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a71269 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.546677:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca8600/0xf54e3944c2a71270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a71269 expref: 19 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.546690:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919044ca8600/0xf54e3944c2a71270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a71269 expref: 19 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.546700:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8600, rc 0) 00000100:00100000:1.0:1788581296.546778:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:15816:x1875463014289920:12345-0@lo:101:mount.lustre.0 Request processed in 165us (2913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581296.546786:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788581296.546844:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014289920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788581296.546862:0:15816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff919044ca9e00/0xf54e3944c2a71269 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71270 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.546872:0:15816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff919044ca9e00/0xf54e3944c2a71269 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a71270 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581296.547532:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788581296.547846:0:15816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581296.548113:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788581296.548157:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788581296.548191:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788581296.548288:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788581296.548331:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788581296.548375:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788581296.548410:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788581296.548443:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788581296.548488:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788581296.548523:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788581296.548557:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788581296.548609:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788581296.548650:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788581296.548685:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788581296.548745:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788581296.548786:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788581296.548826:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788581296.548877:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788581296.548914:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788581296.548951:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788581296.549002:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788581296.549040:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788581296.549074:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788581296.549143:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788581296.549181:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788581296.549220:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788581296.549303:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788581296.549345:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788581296.549382:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788581296.549440:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788581296.549490:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788581296.549527:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788581296.549566:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788581296.549617:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788581296.549653:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788581296.549707:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788581296.549745:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788581296.549834:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788581296.549843:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788581296.549942:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014290048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788581296.550007:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581296.550059:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff919077973480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581296.554016:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014290048 00000100:00100000:2.0:1788581296.554032:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014290048 00000100:00100000:2.0:1788581296.554108:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788581296.554119:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f91a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:15816:x1875463014290048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581296.554955:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f91a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:15816:x1875463014290048:12345-0@lo:501:mount.lustre.0 Request processed in 835us (4945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581296.554966:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788581296.555056:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014290048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788581296.555117:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014290176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581296.555177:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581296.555206:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014290176 00000100:00100000:2.0:1788581296.555211:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014290176 00000100:00100000:2.0:1788581296.555236:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788581296.555267:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f918450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:15816:x1875463014290176:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788581296.557660:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f918450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:15816:x1875463014290176:12345-0@lo:503:mount.lustre.0 Request processed in 2410us (2477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581296.557675:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788581296.557756:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581296.557782:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014290176:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788581296.562004:0:15816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788581296.562130:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014290304:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788581296.562214:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581296.562278:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581296.563584:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014290304 00000100:00100000:3.0:1788581296.563598:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014290304 00000100:00100000:3.0:1788581296.563652:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788581296.563662:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907f918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:15816:x1875463014290304:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581296.564003:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907f918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:15816:x1875463014290304:12345-0@lo:502:mount.lustre.0 Request processed in 341us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581296.564011:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788581296.566140:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014290304:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788581296.566829:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788581296.566900:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788581296.566938:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788581296.566986:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788581296.567026:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788581296.567075:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788581296.567126:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788581296.567159:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788581296.567207:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788581296.567280:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788581296.567318:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788581296.570642:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788581296.570750:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788581296.570785:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788581296.570840:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788581296.570877:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788581296.570914:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788581296.570967:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788581296.571000:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788581296.571032:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788581296.571078:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788581296.571127:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788581296.571161:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788581296.571209:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788581296.571287:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788581296.571326:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788581296.573977:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788581296.574075:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788581296.574125:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788581296.574178:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788581296.574214:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788581296.574265:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788581296.574302:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788581296.574355:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788581296.575939:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788581296.576012:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788581296.576072:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788581296.576121:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788581296.576170:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788581296.576205:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788581296.576288:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014290432:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788581296.576387:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581296.576436:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190768a8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581296.578681:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014290432 00000100:00100000:0.0:1788581296.578696:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014290432 00000100:00100000:0.0:1788581296.578775:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788581296.578786:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904994f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:15816:x1875463014290432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788581296.579069:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904994f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:15816:x1875463014290432:12345-0@lo:502:mount.lustre.0 Request processed in 283us (2682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581296.579077:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788581296.579620:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014290432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788581296.579743:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788581296.579760:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788581296.583772:0:15826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788581296.583797:0:15826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff919047c9b370) 00000020:00000080:0.0:1788581296.583821:0:15826:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788581296.583897:0:15826:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91906be86000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788581296.583901:0:15826:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91906be86000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788581296.583904:0:15826:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91906be86000 3 00010000:00080000:0.0:1788581296.583943:0:15826:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91907bb51800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.113@tcp at head 00010000:00010000:0.0:1788581296.592810:0:15826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788581296.598077:0:15826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788581296.598140:0:15826:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788581296.598153:0:15826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf54e3944c2a7127e 00000100:00080000:2.0:1788581296.598165:0:15826:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788581296.598170:0:15826:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91907bb51800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:2.0:1788581296.598207:0:15826:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9190768c8a80 x1875463014290560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788581296.598237:0:15826:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788581296.598326:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788581296.598331:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788581296.598333:0:38:0:(import.c:65:import_set_state_nolock()) ffff919075ecd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788581296.598337:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 508 00000100:00080000:2.0:1788581296.598341:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788581296.598344:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff919075ecd800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:2.0:1788581296.598491:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9190768c9c00 x1875463014290816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581296.598633:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581296.598647:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014290688:0@lo:400:kworker.0 00000100:00100000:2.0:1788581296.598707:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581296.598842:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3337:1875463014290560:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788581296.598878:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581296.598903:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014290816:0@lo:8:kworker.0 00000100:00100000:0.0:1788581296.598924:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581296.599082:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014290560 00000100:00100000:0.0:1788581296.599100:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014290560 00000100:00100000:0.0:1788581296.599137:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581296.599145:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3337:x1875463014290560:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788581296.599169:0:14418:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:0.0:1788581296.599206:0:14418:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf54e3944c2a71285 00000004:00100000:0.0:1788581296.599222:0:14418:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788581296.599278:0:14418:0:(import.c:65:import_set_state_nolock()) ffff91907bb54000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581296.599328:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3337:x1875463014290560:12345-0@lo:38:llog_process_th.0 Request processed in 182us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581296.599336:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788581296.599462:0:3337:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9190768c8a80 x1875463014290560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581296.599472:0:3337:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788581296.599479:0:3337:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788581296.599486:0:3337:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:3.0:1788581296.599674:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014290688 00000100:00100000:3.0:1788581296.599680:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014290688 00000100:00100000:3.0:1788581296.599718:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014290816 00000100:00100000:3.0:1788581296.599721:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014290816 00000100:00100000:3.0:1788581296.599732:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581296.599740:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3338:x1875463014290688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581296.599784:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3338:x1875463014290688:12345-0@lo:400:kworker.0 Request processed in 47us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581296.599801:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581296.599815:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581296.599818:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3337:x1875463014290816:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788581296.599853:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3337:x1875463014290816:12345-0@lo:8:kworker.0 Request processed in 32us (927us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788581296.599859:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581296.599888:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014290688:0@lo:400:kworker.0 00000040:00080000:3.0:1788581296.600227:0:15826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788581296.600390:0:15816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788581296.600414:0:15816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788581296.600429:0:15816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff919044ca9e00/0xf54e3944c2a71269 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71270 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581296.600439:0:15816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff919044ca9e00/0xf54e3944c2a71269 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71270 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788581296.600485:0:15816:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788581296.600487:0:15816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788581296.600488:0:15816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581296.600489:0:15816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581296.600490:0:15816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581296.600491:0:15816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581296.600493:0:15816:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788581296.600495:0:15816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581296.600683:0:15816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788581296.600689:0:15816:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788581296.600691:0:15816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788581296.600693:0:15816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788581296.600694:0:15816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581296.600695:0:15816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581296.600696:0:15816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581296.600702:0:15816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581296.600703:0:15816:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788581296.600704:0:15816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581296.600705:0:15816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788581296.600722:0:15816:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788581296.600736:0:15816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014291200:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788581296.600777:0:15816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581296.600801:0:15816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190768a8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581296.600871:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014291200 00000100:00100000:2.0:1788581296.600877:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014291200 00000100:00100000:2.0:1788581296.600913:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788581296.600921:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904994d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:15816:x1875463014291200:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788581296.600943:0:14412:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788581296.600958:0:14412:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1788581296.601734:0:3337:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788581296.601742:0:3337:0:(import.c:65:import_set_state_nolock()) ffff91907bb51800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788581296.601752:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3337:1875463014290560:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788581296.601777:0:3337:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788581296.601781:0:3337:0:(import.c:65:import_set_state_nolock()) ffff919075ecd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788581296.601785:0:3337:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788581296.601789:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014290816:0@lo:8:kworker.0 00000100:00080000:0.0:1788581296.601815:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581296.604898:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014290944:0@lo:400:kworker.0 00000100:00100000:1.0:1788581296.604972:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581296.605014:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581296.605021:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014291072:0@lo:400:kworker.0 00000100:00100000:1.0:1788581296.605064:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581296.606482:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014290944 00000100:00100000:0.0:1788581296.606492:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014290944 00000100:00100000:0.0:1788581296.606548:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014291072 00000100:00100000:0.0:1788581296.606552:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014291072 00000100:00100000:0.0:1788581296.606582:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581296.606590:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014290944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581296.606662:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014290944:12345-0@lo:400:kworker.0 Request processed in 72us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581296.606669:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581296.606684:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788581296.606690:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014291072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581296.606717:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014291072:12345-0@lo:400:kworker.0 Request processed in 28us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581296.606722:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788581296.606737:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788581296.606765:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9190768c9880 x1875463014291072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581296.606779:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014291072:0@lo:400:kworker.0 00010000:00080000:0.0:1788581296.606805:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9190768c8700 x1875463014290944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581296.606813:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014290944:0@lo:400:kworker.0 20000000:01000000:1.0:1788581296.639709:0:14412:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788581296.639731:0:14412:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788581296.640341:0:14432:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788581296.640348:0:14432:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788581296.640383:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919075b7c800/0xf54e3944c2a7128c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581296.640403:0:14432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a7115f expref: 19 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581296.640411:0:14432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919075b7c800/0xf54e3944c2a7128c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581296.640452:0:14432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a7115f expref: 19 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581296.640467:0:14432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a7115f expref: 19 pid: 14412 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581296.640480:0:14432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14432:1875463014291328:0@lo:104: 00000100:00100000:0.0:1788581296.640724:0:14432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581296.640775:0:14432:0:(client.c:2715:ptlrpc_set_wait()) set ffff919050d75d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581296.640805:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014291328 00000100:00100000:1.0:1788581296.640813:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014291328 00000100:00100000:1.0:1788581296.640863:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581296.640872:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b910700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+3:14432:x1875463014291328:12345-0@lo:104: 00010000:00010000:1.0:1788581296.640887:0:14400:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91906cb62e00/0xf54e3944c2a7115f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a71166 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.640960:0:14400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788581296.640968:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b910700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+3:14432:x1875463014291328:12345-0@lo:104: Request processed in 97us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581296.640984:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788581296.641006:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581296.641012:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91906cb62e00/0xf54e3944c2a7115f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a71166 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.641021:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb62e00 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:1.0:1788581296.641025:0:14406:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91906cb62e00/0xf54e3944c2a7115f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a71166 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.641034:0:14406:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91906cb62e00/0xf54e3944c2a7115f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a71166 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581296.641042:0:14406:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91906cb62e00/0xf54e3944c2a7115f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a71166 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581296.641048:0:14406:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581296.641094:0:14406:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91906cb62e00/0xf54e3944c2a7115f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a71166 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.641101:0:14406:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581296.641123:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91906cb62e00/0xf54e3944c2a7115f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a71166 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.641129:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91906cb62e00/0xf54e3944c2a7115f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a71166 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581296.641144:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581296.641146:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581296.641148:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581296.641160:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3338:1875463014291456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581296.641195:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581296.641367:0:14432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14432:1875463014291328:0@lo:104: 00010000:00010000:3.0:1788581296.641386:0:14432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919075b7c800/0xf54e3944c2a7128c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581296.641452:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014291456 00000100:00100000:2.0:1788581296.641458:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014291456 00010000:00010000:2.0:1788581296.641479:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a7115f expref: 20 pid: 14412 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581296.641526:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581296.641534:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+20:3338:x1875463014291456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788581296.641545:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581296.641551:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a7115f expref: 20 pid: 14412 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581296.641561:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a7115f expref: 20 pid: 14412 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581296.641573:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91907bc22e00/0xf54e3944c2a71166 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a7115f expref: 20 pid: 14412 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581296.641584:0:14404:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919075b7c800/0xf54e3944c2a7128c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581296.641591:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919075b7c800/0xf54e3944c2a7128c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788581296.641603:0:14404:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001256179s 00010000:00010000:2.0:1788581296.641607:0:14404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919075b7c800/0xf54e3944c2a7128c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581296.641613:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919075b7c800/0xf54e3944c2a7128c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581296.641619:0:14404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919075b7c800/0xf54e3944c2a7128c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581296.641625:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919075b7c800/0xf54e3944c2a7128c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581296.641636:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919075b7c800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:2.0:1788581296.641640:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919075b7c800/0xf54e3944c2a7128c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581296.641647:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919075b7c800/0xf54e3944c2a7128c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581296.641668:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919075b7c800/0xf54e3944c2a7128c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581296.641678:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581296.641720:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:3338:x1875463014291456:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581296.641726:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788581296.641751:0:14432:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919075b7c800/0xf54e3944c2a7128c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581296.641761:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919075b7c800/0xf54e3944c2a7128c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581296.641767:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919075b7c800/0xf54e3944c2a7128c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581296.641864:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3338:1875463014291456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788581296.662520:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904994d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:15816:x1875463014291200:12345-0@lo:253:mount.lustre.0 Request processed in 61589us (61732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581296.662536:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788581296.662548:0:15816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c4ed75f-0e9f-4624-94e3-96119520d4d4:15816:1875463014291200:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788581296.662565:0:15816:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788581296.662569:0:15816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788581296.662571:0:15816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788581296.662573:0:15816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581296.662575:0:15816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581296.662591:0:15816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581296.662592:0:15816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581296.662594:0:15816:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788581296.662596:0:15816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581296.662598:0:15816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788581296.662612:0:15816:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788581296.673204:0:15816:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788581296.673428:0:15816:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788581296.673591:0:15816:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788581296.673735:0:15816:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788581296.673881:0:15816:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788581296.674068:0:15816:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788581296.675377:0:15816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788581296.750062:0:15816:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788581296.750128:0:15816:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788581296.750169:0:15816:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788581296.750234:0:15816:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.113@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788581296.750456:0:15816:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788581296.750491:0:15816:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788581297.137971:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581297.780052:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014291584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581297.780142:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581297.780225:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014291584 00000100:00100000:1.0:1788581297.780233:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014291584 00000100:00100000:1.0:1788581297.780295:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581297.780304:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3339:x1875463014291584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581297.780336:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581297.780376:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3339:x1875463014291584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581297.780384:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581297.780426:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014291584:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788581297.907142:0:6750:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788581297.907168:0:6750:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 10000000:01000000:2.0:1788581298.031326:0:14414:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788581298.031337:0:14414:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff919059822800 from 8 10000000:01000000:2.0:1788581298.031343:0:14414:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788581298.031400:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62a00/0xf54e3944c2a71293 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.031412:0:14414:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91906cb62a00/0xf54e3944c2a71293 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581298.031424:0:14414:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91906cb62a00/0xf54e3944c2a71293 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581298.031452:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9190768cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014291712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788581298.031538:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581298.031600:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f431d3480 going to sleep for 11 seconds 00000100:00100000:0.0:1788581298.031741:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014291712 00000100:00100000:0.0:1788581298.031752:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014291712 00000100:00100000:0.0:1788581298.031816:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788581298.031826:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904994d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:14414:x1875463014291712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581298.031839:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581298.031854:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919075b7d800/0xf54e3944c2a7129a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a71293 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581298.031879:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919075b7d800/0xf54e3944c2a7129a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a71293 expref: 19 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581298.031890:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919075b7d800/0xf54e3944c2a7129a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a71293 expref: 19 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581298.031898:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919075b7d800, rc 0) 00000100:00100000:0.0:1788581298.031951:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904994d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:14414:x1875463014291712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581298.031959:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788581298.032075:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9190768cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014291712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581298.032099:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91906cb62a00/0xf54e3944c2a71293 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7129a expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581298.032122:0:14414:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91906cb62a00/0xf54e3944c2a71293 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a7129a expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581298.032172:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014291840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788581298.032207:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581298.032236:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190467e5000 going to sleep for 11 seconds 00000100:00100000:0.0:1788581298.032433:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014291840 00000100:00100000:0.0:1788581298.032437:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014291840 00000100:00100000:0.0:1788581298.032466:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788581298.032482:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904994f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:14414:x1875463014291840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788581298.032496:0:14412:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788581298.032512:0:14412:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788581298.032518:0:14412:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788581298.032602:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904994f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:14414:x1875463014291840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581298.032609:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788581298.032681:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014291840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788581298.032741:0:14414:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788581298.032748:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62a00/0xf54e3944c2a71293 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7129a expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581298.032757:0:14414:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91906cb62a00/0xf54e3944c2a71293 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a7129a expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581298.160123:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581299.184375:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788581299.632194:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788581300.207369:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581301.247417:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788581301.872351:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788581301.872359:0:474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788581301.872362:0:474:0:(import.c:65:import_set_state_nolock()) ffff919075ecd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788581301.872373:0:474:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff919075ecd800 using connection 192.168.201.113@tcp/0@lo 00000100:00100000:1.0:1788581301.872395:0:474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907b97c700 x1875463014292224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581301.872470:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3340:1875463014291968:0@lo:400:kworker.0 00000100:00100000:1.0:1788581301.872542:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581301.872599:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014292608:0@lo:400:kworker.0 00000100:00100000:1.0:1788581301.872630:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581301.872658:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581301.872663:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014292096:0@lo:400:kworker.0 00000100:00100000:1.0:1788581301.872691:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581301.872720:0:3337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014292224:0@lo:8:kworker.0 00000100:00100000:1.0:1788581301.872749:0:3337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581301.872779:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3338:1875463014292352:0@lo:400:kworker.0 00000100:00100000:1.0:1788581301.872822:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581301.872842:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581301.872847:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014292480:0@lo:400:kworker.0 00000100:00100000:1.0:1788581301.872867:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581301.872898:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014291968 00000100:00100000:1.0:1788581301.872905:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014291968 00000100:00100000:1.0:1788581301.872946:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788581301.872955:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904994e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:3340:x1875463014291968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581301.873018:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904994e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:3340:x1875463014291968:12345-0@lo:400:kworker.0 Request processed in 63us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581301.873026:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788581301.873055:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014292608 00000100:00100000:1.0:1788581301.873058:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014292608 00000100:00100000:1.0:1788581301.873086:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014292352 00000100:00100000:1.0:1788581301.873089:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014292352 00000100:00100000:1.0:1788581301.873099:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014292480 00000100:00100000:1.0:1788581301.873101:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014292480 00000100:00100000:1.0:1788581301.873116:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581301.873121:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014292608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581301.873148:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014292608:12345-0@lo:400:kworker.0 Request processed in 27us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581301.873153:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581301.873163:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581301.873168:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3338:x1875463014292352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581301.873192:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3338:x1875463014292352:12345-0@lo:400:kworker.0 Request processed in 24us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581301.873197:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581301.873213:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788581301.873218:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014292480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581301.873241:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014292480:12345-0@lo:400:kworker.0 Request processed in 23us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581301.873267:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788581301.873284:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014292096 00000100:00100000:1.0:1788581301.873287:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014292096 00000100:00100000:1.0:1788581301.873309:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014292224 00000100:00100000:1.0:1788581301.873311:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014292224 00000100:00100000:1.0:1788581301.873319:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581301.873325:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014292096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581301.873350:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014292096:12345-0@lo:400:kworker.0 Request processed in 26us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581301.873355:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581301.873364:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581301.873368:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3337:x1875463014292224:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788581301.873391:0:15099:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:1.0:1788581301.873418:0:15099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf54e3944c2a712a1 00002000:00100000:1.0:1788581301.873433:0:15099:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff919066dbe800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788581301.873437:0:15099:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788581301.873440:0:15099:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788581301.873772:0:15099:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788581301.873797:0:15099:0:(import.c:65:import_set_state_nolock()) ffff919066db8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581301.873837:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3337:x1875463014292224:12345-0@lo:8:kworker.0 Request processed in 467us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581301.873844:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788581301.873868:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581301.873878:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788581301.873908:0:3337:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907b97c700 x1875463014292224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788581301.873924:0:3337:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788581301.873932:0:3337:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788581301.873936:0:3337:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788581301.873938:0:3337:0:(import.c:65:import_set_state_nolock()) ffff919075ecd800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788581301.873950:0:3337:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788581301.873955:0:3337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3337:1875463014292224:0@lo:8:kworker.0 00010000:00080000:1.0:1788581301.873988:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907b97e300 x1875463014292480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581301.874011:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014292480:0@lo:400:kworker.0 00010000:00080000:1.0:1788581301.874023:0:3338:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907b97c380 x1875463014292352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581301.874031:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3338:1875463014292352:0@lo:400:kworker.0 00000100:00100000:1.0:1788581301.874060:0:3340:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788581301.874070:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014292096:0@lo:400:kworker.0 00000100:00100000:1.0:1788581301.874079:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3340:1875463014291968:0@lo:400:kworker.0 00010000:00080000:1.0:1788581301.874089:0:3340:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907b97f100 x1875463014292608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581301.874097:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014292608:0@lo:400:kworker.0 00000004:00080000:3.0:1788581301.874388:0:14441:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788581301.874407:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14441:1875463014292864:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788581301.874456:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581301.874473:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190467e5240 going to sleep for 11 seconds 00000004:00080000:3.0:1788581301.874488:0:14440:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788581301.874851:0:14440:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 518115606365ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788581301.875116:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014292736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581301.875146:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581301.875561:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014292864 00000100:00100000:3.0:1788581301.875570:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014292864 00000100:00100000:3.0:1788581301.875660:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788581301.875669:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14441:x1875463014292864:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788581301.877200:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014292736 00000100:00100000:1.0:1788581301.877212:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014292736 00000100:00100000:1.0:1788581301.877291:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581301.877309:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3341:x1875463014292736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581301.877338:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581301.877420:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3341:x1875463014292736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (2271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581301.877427:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788581301.877496:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788581301.877530:0:3341:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91906c7e3100 x1875463014292736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581301.877550:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014292736:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1788581301.879847:0:15099:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788581301.879857:0:15099:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788581301.879863:0:15099:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1788581301.894210:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.894223:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a712a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.894471:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.894476:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.894483:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a712a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.894501:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a712a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.894511:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a712a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.894518:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a712a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.894543:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788581301.894984:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.894990:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d834673/0xf54e3944c2a712af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895009:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.895013:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.895017:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d834673/0xf54e3944c2a712af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895026:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d834673/0xf54e3944c2a712af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895046:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d834673/0xf54e3944c2a712af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895053:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d834673/0xf54e3944c2a712af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895071:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788581301.895085:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581301.895092:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a712a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895100:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce000 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581301.895105:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a712a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895115:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a712a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895133:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a712a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895140:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faf36045/0xf54e3944c2a712a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895162:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581301.895172:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d834673/0xf54e3944c2a712af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895179:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf400 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581301.895183:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d834673/0xf54e3944c2a712af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895190:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d834673/0xf54e3944c2a712af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895201:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d834673/0xf54e3944c2a712af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895208:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d834673/0xf54e3944c2a712af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895220:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.895221:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.895223:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581301.895682:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.895688:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a712b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895697:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.895701:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.895706:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a712b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895726:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a712b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895734:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a712b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895742:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a712b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895756:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581301.895764:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581301.895768:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a712b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895774:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581301.895778:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a712b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895785:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a712b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895794:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a712b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895801:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067fed1a3/0xf54e3944c2a712b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.895821:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.895823:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.895825:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581301.896202:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.896209:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a712bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896217:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.896221:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.896225:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a712bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896233:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a712bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896266:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a712bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896275:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a712bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896287:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581301.896295:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581301.896298:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a712bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896314:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581301.896317:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a712bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896324:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a712bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896334:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a712bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896340:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a712bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896353:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.896355:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.896357:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581301.896705:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.896710:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a712c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896717:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.896720:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.896724:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a712c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896732:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a712c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896745:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a712c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896752:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a712c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896764:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581301.896770:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581301.896773:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a712c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896779:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf000 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581301.896782:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a712c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896789:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a712c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896799:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a712c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896805:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a712c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.896818:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.896825:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.896826:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581301.897121:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581301.900791:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.900807:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a712cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.900826:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.900831:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.900838:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a712cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.900853:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a712cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.900864:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a712cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.900871:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a712cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.900887:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581301.900898:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581301.900903:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a712cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.900910:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cee00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581301.900914:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a712cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.900934:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a712cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.900949:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a712cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.900955:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a712cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.900975:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.900977:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.900978:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581301.901455:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.901462:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a712d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.901471:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.901474:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.901479:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a712d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.901488:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a712d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.901496:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a712d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.901508:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a712d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.901525:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581301.901535:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581301.901539:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a712d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.901546:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cfa00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581301.901549:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a712d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.901557:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a712d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.901568:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a712d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.901575:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a712d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.901589:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.901591:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.901593:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581301.901985:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.902009:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a712d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902018:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.902021:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.902025:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a712d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902035:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a712d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902043:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a712d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902050:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a712d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902063:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581301.902070:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581301.902074:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a712d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902080:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b3200 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581301.902084:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a712d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902091:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a712d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902107:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a712d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902115:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a712d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902128:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.902130:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.902131:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581301.902497:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.902503:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a712e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902511:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.902515:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.902519:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a712e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902528:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a712e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902536:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a712e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902543:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a712e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902565:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788581301.902573:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581301.902577:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a712e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902583:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b3800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581301.902587:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a712e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902594:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a712e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902605:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a712e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902612:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a712e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902624:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.902626:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.902627:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581301.902947:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.902953:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a712e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902962:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.902969:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.902973:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a712e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902982:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a712e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.902989:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a712e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.908452:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a712e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.909078:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788581301.909639:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.909648:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a712ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.909663:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.909668:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.909675:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a712ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.909689:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a712ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.909700:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a712ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.909714:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a712ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.914845:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581301.914861:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a712e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.914875:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b2a00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.914880:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a712e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.914891:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a712e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.914917:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a712e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.914925:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a712e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.914963:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581301.914966:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a712ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.914973:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b3000 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.914976:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a712ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.914983:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a712ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.915003:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a712ee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.915012:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.915014:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.915017:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.916936:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788581301.916951:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a712ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788581301.920878:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788581301.920891:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581301.920908:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1788581301.920913:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581301.920920:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581301.920935:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581301.920946:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581301.920953:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581301.920980:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788581301.921069:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581301.921077:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.921085:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb62200 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.921090:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.921112:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.921129:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.921137:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.921157:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.921159:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.921160:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581301.921282:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788581301.932559:0:5899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788581301.934090:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788581301.934104:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581301.934126:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1788581301.934132:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581301.934139:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581301.934169:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581301.934181:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581301.934191:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581301.934321:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788581301.934802:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788581301.934809:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a64a20d0/0xf54e3944c2a71303 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581301.934817:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1788581301.934821:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581301.934824:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a64a20d0/0xf54e3944c2a71303 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581301.934833:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a64a20d0/0xf54e3944c2a71303 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581301.934840:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a64a20d0/0xf54e3944c2a71303 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581301.934857:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a64a20d0/0xf54e3944c2a71303 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.937342:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581301.937361:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.937377:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb62200 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.937382:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.937394:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.937431:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.937452:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eba93fc8/0xf54e3944c2a712fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.937476:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581301.937480:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a64a20d0/0xf54e3944c2a71303 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.937487:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb62800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.937490:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a64a20d0/0xf54e3944c2a71303 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.937498:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a64a20d0/0xf54e3944c2a71303 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.937509:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a64a20d0/0xf54e3944c2a71303 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.937517:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.937519:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.937521:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581301.937667:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788581301.937676:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a64a20d0/0xf54e3944c2a71303 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.938396:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581301.938641:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.938651:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a7130a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.938665:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.938669:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.938675:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a7130a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.938690:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a7130a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.938699:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a7130a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.938707:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a7130a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.938780:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788581301.939171:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.939177:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a71311 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.939187:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.939190:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.939194:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a71311 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.939204:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a71311 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.939212:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a71311 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.939220:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a71311 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.939333:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581301.939340:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a7130a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.939348:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b3000 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.939357:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a7130a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.939366:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a7130a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.939381:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a7130a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.939708:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd7fc8b9/0xf54e3944c2a7130a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.939726:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581301.939729:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a71311 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.939736:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b3800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.939739:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a71311 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.939746:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a71311 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.939756:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a71311 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.939763:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.939769:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.939772:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.939825:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788581301.939830:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edac88c4/0xf54e3944c2a71311 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.941057:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581301.941148:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.941158:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a71318 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.941177:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.941181:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.941186:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a71318 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.941199:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a71318 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.941208:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a71318 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.941216:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a71318 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.941348:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788581301.941788:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.941795:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cdb8665/0xf54e3944c2a7131f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.941804:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.941808:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.941812:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cdb8665/0xf54e3944c2a7131f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.941822:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cdb8665/0xf54e3944c2a7131f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.941840:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cdb8665/0xf54e3944c2a7131f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.941846:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cdb8665/0xf54e3944c2a7131f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.941943:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788581301.941949:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a71318 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.941956:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b3200 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.941960:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a71318 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.941968:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a71318 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.941983:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a71318 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.941990:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bccd548/0xf54e3944c2a71318 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.942019:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581301.942022:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cdb8665/0xf54e3944c2a7131f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.942028:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b2e00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.942031:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cdb8665/0xf54e3944c2a7131f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.942049:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cdb8665/0xf54e3944c2a7131f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.942059:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cdb8665/0xf54e3944c2a7131f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.942066:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.942068:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.942070:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.942138:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788581301.942144:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cdb8665/0xf54e3944c2a7131f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581301.942710:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.942717:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000100ee921/0xf54e3944c2a71326 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.942726:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.942730:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.942734:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000100ee921/0xf54e3944c2a71326 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.942745:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000100ee921/0xf54e3944c2a71326 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.942753:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000100ee921/0xf54e3944c2a71326 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.942771:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000100ee921/0xf54e3944c2a71326 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.942823:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581301.942829:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000100ee921/0xf54e3944c2a71326 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.942836:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b2200 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.942840:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000100ee921/0xf54e3944c2a71326 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.942848:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000100ee921/0xf54e3944c2a71326 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.942859:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000100ee921/0xf54e3944c2a71326 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.942867:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.942869:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.942871:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.942940:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788581301.942945:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000100ee921/0xf54e3944c2a71326 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581301.943393:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.943399:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c36d4853/0xf54e3944c2a7132d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.943420:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.943424:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.943428:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c36d4853/0xf54e3944c2a7132d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.943438:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c36d4853/0xf54e3944c2a7132d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.943446:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c36d4853/0xf54e3944c2a7132d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.943452:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c36d4853/0xf54e3944c2a7132d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.943629:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581301.943634:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c36d4853/0xf54e3944c2a7132d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.943642:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b3a00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.943646:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c36d4853/0xf54e3944c2a7132d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.943654:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c36d4853/0xf54e3944c2a7132d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.943665:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c36d4853/0xf54e3944c2a7132d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.943673:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.943675:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.943676:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.943734:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788581301.943739:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c36d4853/0xf54e3944c2a7132d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581301.944147:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.944153:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa42ed1e/0xf54e3944c2a71334 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.944163:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.944166:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.944170:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa42ed1e/0xf54e3944c2a71334 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.944180:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa42ed1e/0xf54e3944c2a71334 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.944188:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa42ed1e/0xf54e3944c2a71334 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.944195:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa42ed1e/0xf54e3944c2a71334 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.944352:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581301.944359:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa42ed1e/0xf54e3944c2a71334 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.944366:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b2000 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.944369:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa42ed1e/0xf54e3944c2a71334 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.944377:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa42ed1e/0xf54e3944c2a71334 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.944401:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa42ed1e/0xf54e3944c2a71334 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.944480:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.944482:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.944484:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.944556:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788581301.944562:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa42ed1e/0xf54e3944c2a71334 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581301.944950:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.944955:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678f837/0xf54e3944c2a7133b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.944964:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.944967:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.944972:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004678f837/0xf54e3944c2a7133b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.944981:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004678f837/0xf54e3944c2a7133b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.944989:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678f837/0xf54e3944c2a7133b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.945007:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004678f837/0xf54e3944c2a7133b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.945031:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581301.945036:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004678f837/0xf54e3944c2a7133b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.945043:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b2800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.945047:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004678f837/0xf54e3944c2a7133b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.945054:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004678f837/0xf54e3944c2a7133b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.945064:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004678f837/0xf54e3944c2a7133b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.945071:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.945073:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.945074:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.945130:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788581301.945135:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004678f837/0xf54e3944c2a7133b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581301.945923:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.945930:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b480532/0xf54e3944c2a71342 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.945949:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.945952:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.945957:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b480532/0xf54e3944c2a71342 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.945967:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b480532/0xf54e3944c2a71342 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.945975:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b480532/0xf54e3944c2a71342 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.945982:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b480532/0xf54e3944c2a71342 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.946041:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581301.946047:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b480532/0xf54e3944c2a71342 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.946064:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b3400 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.946068:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b480532/0xf54e3944c2a71342 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.946075:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b480532/0xf54e3944c2a71342 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.946088:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b480532/0xf54e3944c2a71342 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.946096:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.946098:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.946099:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.946162:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788581301.946167:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b480532/0xf54e3944c2a71342 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581301.946845:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.946851:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a71349 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.946860:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.946863:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.946868:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a71349 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.946889:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a71349 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.946898:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a71349 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.946905:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a71349 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.946957:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581301.946963:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a71349 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.946971:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190414b2a00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.946974:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a71349 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.946982:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a71349 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.947004:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a71349 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.947020:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.947022:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.947024:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.947086:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788581301.947091:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002724cebf/0xf54e3944c2a71349 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581301.947637:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.947644:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a71350 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.947653:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.947656:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.947661:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a71350 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.947670:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a71350 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.947689:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a71350 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.947697:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a71350 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.947744:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581301.947750:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a71350 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.947758:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cfa00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.947761:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a71350 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.947769:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a71350 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.947781:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a71350 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.947788:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.947789:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.947791:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.947852:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788581301.947857:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c6400ea/0xf54e3944c2a71350 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581301.948285:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.948291:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a71357 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.948299:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.948302:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.948306:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a71357 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.948315:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a71357 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.948322:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a71357 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.948339:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a71357 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.948505:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581301.948512:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a71357 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.948520:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cee00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.948523:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a71357 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.948536:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a71357 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.948547:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a71357 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.948554:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.948556:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.948557:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.948610:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788581301.948615:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a80d6376/0xf54e3944c2a71357 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581301.948992:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.949009:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a7135e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.949017:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.949020:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.949024:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a7135e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.949032:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a7135e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.949039:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a7135e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.949045:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a7135e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.949086:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581301.949091:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a7135e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.949098:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf000 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.949102:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a7135e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.949110:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a7135e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.949120:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a7135e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.949128:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.949129:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.949131:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.949745:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788581301.949752:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc62cf60/0xf54e3944c2a7135e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788581301.950183:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788581301.950189:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a71365 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.950200:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788581301.950203:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581301.950208:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a71365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.950218:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a71365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.950226:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a71365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581301.950234:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a71365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.950334:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581301.950341:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a71365 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.950349:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce800 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581301.950352:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a71365 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.950361:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a71365 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.950375:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a71365 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581301.950383:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.950385:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581301.950386:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581301.950527:0:15099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788581301.950532:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009edfae12/0xf54e3944c2a71365 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788581301.950765:0:15099:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1788581301.950867:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14441:x1875463014292864:12345-0@lo:5:osp-pre-1-0.0 Request processed in 75194us (76405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581301.950878:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788581301.950968:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14441:1875463014292864:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788581301.950982:0:14441:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788581301.951034:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14441:1875463014292992:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788581301.951064:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581301.951112:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff91907f94ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581301.951156:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014292992 00000100:00100000:2.0:1788581301.951162:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014292992 00000100:00100000:2.0:1788581301.951207:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788581301.951215:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14441:x1875463014292992:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788581301.951276:0:15100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1788581301.953351:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581301.957474:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14441:x1875463014292992:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6187us (6336us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788581301.957489:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581301.961472:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14441:1875463014292992:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788581301.961494:0:14441:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1788581302.255443:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788581302.518819:0:16173:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg113-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788581302.902415:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581302.902441:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014293120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581302.902525:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581302.902773:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014293120 00000100:00100000:0.0:1788581302.902782:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014293120 00000100:00100000:0.0:1788581302.902951:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581302.902962:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014293120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788581302.903004:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581302.903058:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014293120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581302.903065:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581302.903108:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014293120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788581303.279417:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581304.317302:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581304.384758:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581304.384922:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995420032 00000100:00100000:2.0:1788581304.384933:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995420032 00000100:00100000:2.0:1788581304.384987:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 75 00000100:00100000:2.0:1788581304.384995:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2371:x1875462995420032:12345-192.168.201.13@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788581304.385024:0:14411:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 04cbc643-64a0-4a77-9b56-cef82e5dcfcc@192.168.201.13@tcp t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:2.0:1788581304.385054:0:14411:0:(genops.c:1385:class_connect()) connect: client 04cbc643-64a0-4a77-9b56-cef82e5dcfcc, cookie 0xf54e3944c2a7136c 00000100:00080000:2.0:1788581304.385482:0:14411:0:(import.c:65:import_set_state_nolock()) ffff919048b50800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581304.385569:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+5:2371:x1875462995420032:12345-192.168.201.13@tcp:250:mount.lustre.0 Request processed in 572us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581304.385577:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 75 00000100:00100000:1.0:1788581304.392767:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581304.395756:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995420160 00000100:00100000:3.0:1788581304.395783:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995420160 00000100:00100000:2.0:1788581304.396051:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 76 00000100:00100000:2.0:1788581304.396067:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+5:13767:x1875462995420160:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788581304.396086:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581304.396104:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91906cb63800/0xf54e3944c2a71373 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d93d0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581304.396132:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91906cb63800/0xf54e3944c2a71373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d93d0 expref: 6 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581304.396143:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91906cb63800/0xf54e3944c2a71373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d93d0 expref: 6 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581304.396152:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91906cb63800, rc 0) 00000100:00100000:2.0:1788581304.396215:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+6:13767:x1875462995420160:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 152us (3463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581304.396223:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 76 00000100:00100000:1.0:1788581304.399084:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581304.399195:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995420288 00000100:00100000:2.0:1788581304.399209:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995420288 00000100:00100000:2.0:1788581304.400740:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 77 00000100:00100000:2.0:1788581304.400760:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+6:13767:x1875462995420288:12345-192.168.201.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788581304.401058:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+6:13767:x1875462995420288:12345-192.168.201.13@tcp:501:mount.lustre.0 Request processed in 306us (1990us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581304.401066:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 77 00000100:00100000:1.0:1788581304.404969:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581304.405094:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995420416 00000100:00100000:2.0:1788581304.405107:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995420416 00000100:00100000:2.0:1788581304.405174:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 78 00000100:00100000:2.0:1788581304.405186:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+6:13767:x1875462995420416:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788581304.405209:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581304.405231:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91906cb62000/0xf54e3944c2a7137a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d93d7 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581304.405310:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91906cb62000/0xf54e3944c2a7137a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d93d7 expref: 7 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581304.405323:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91906cb62000/0xf54e3944c2a7137a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d93d7 expref: 7 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581304.405335:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91906cb62000, rc 0) 00000100:00100000:2.0:1788581304.405415:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+7:13767:x1875462995420416:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 230us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581304.405423:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 78 00000100:00100000:3.0:1788581304.413937:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581304.414630:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995420544 00000100:00100000:2.0:1788581304.414646:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995420544 00000100:00100000:2.0:1788581304.414721:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 79 00000100:00100000:2.0:1788581304.414733:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+7:13767:x1875462995420544:12345-192.168.201.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788581304.415146:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+8:13767:x1875462995420544:12345-192.168.201.13@tcp:501:mount.lustre.0 Request processed in 415us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581304.415156:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 79 00000100:00100000:3.0:1788581304.428187:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581304.428333:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995420672 00000100:00100000:1.0:1788581304.428348:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995420672 00000100:00100000:1.0:1788581304.428417:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 80 00000100:00100000:1.0:1788581304.428429:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+8:13767:x1875462995420672:12345-192.168.201.13@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788581304.428916:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+8:13767:x1875462995420672:12345-192.168.201.13@tcp:503:mount.lustre.0 Request processed in 489us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581304.428927:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 80 00000100:00100000:1.0:1788581304.432998:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581304.433307:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995420800 00000100:00100000:3.0:1788581304.433321:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995420800 00000100:00100000:3.0:1788581304.433454:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 81 00000100:00100000:3.0:1788581304.433480:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+8:13785:x1875462995420800:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788581304.433899:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+8:13785:x1875462995420800:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 431us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581304.433908:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 81 00000100:00100000:2.0:1788581304.465791:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581304.465906:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995420928 00000100:00100000:1.0:1788581304.465920:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995420928 00000100:00100000:1.0:1788581304.465999:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 82 00000100:00100000:1.0:1788581304.466011:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+8:13785:x1875462995420928:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788581304.466416:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+8:13785:x1875462995420928:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 404us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581304.466427:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 82 00000100:00100000:1.0:1788581304.473410:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581304.474053:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995421056 00000100:00100000:3.0:1788581304.474069:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995421056 00000100:00100000:3.0:1788581304.474150:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 83 00000100:00100000:3.0:1788581304.474163:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+8:13767:x1875462995421056:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788581304.474209:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581304.474233:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821cf000/0xf54e3944c2a71381 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9401 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581304.474301:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821cf000/0xf54e3944c2a71381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9401 expref: 9 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581304.474314:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821cf000/0xf54e3944c2a71381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9401 expref: 9 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581304.474326:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf000, rc 0) 00000100:00100000:3.0:1788581304.474417:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+9:13767:x1875462995421056:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 256us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581304.474425:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 83 00000100:00100000:3.0:1788581304.482632:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581304.484577:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995421184 00000100:00100000:2.0:1788581304.484620:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995421184 00000100:00100000:2.0:1788581304.484712:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 84 00000100:00100000:2.0:1788581304.484725:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+9:13767:x1875462995421184:12345-192.168.201.13@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788581304.484762:0:14411:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788581304.484785:0:14411:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788581304.484790:0:14411:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788581304.484793:0:14411:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788581304.484797:0:14411:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788581304.488088:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+9:13767:x1875462995421184:12345-192.168.201.13@tcp:256:mount.lustre.0 Request processed in 3346us (5451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581304.488107:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 84 00000100:00100000:1.0:1788581304.498509:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581304.498799:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995421312 00000100:00100000:0.0:1788581304.498813:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995421312 00000100:00100000:0.0:1788581304.498887:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 85 00000100:00100000:0.0:1788581304.498899:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+9:13767:x1875462995421312:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788581304.498943:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581304.498976:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919075b7c600/0xf54e3944c2a71388 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9408 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581304.499014:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919075b7c600/0xf54e3944c2a71388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9408 expref: 10 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581304.499026:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919075b7c600/0xf54e3944c2a71388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9408 expref: 10 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581304.499038:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919075b7c600, rc 0) 00000100:00100000:0.0:1788581304.499118:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+10:13767:x1875462995421312:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 221us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581304.499126:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 85 00000100:00100000:3.0:1788581304.506789:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581304.507014:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995421440 00000100:00100000:0.0:1788581304.507033:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995421440 00000100:00100000:0.0:1788581304.507129:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 86 00000100:00100000:0.0:1788581304.507141:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+10:13767:x1875462995421440:12345-192.168.201.13@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788581304.507854:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+10:13767:x1875462995421440:12345-192.168.201.13@tcp:501:mount.lustre.0 Request processed in 711us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581304.507879:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 86 00000100:00100000:2.0:1788581304.518457:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581304.518647:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995421568 00000100:00100000:3.0:1788581304.518661:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995421568 00000100:00100000:3.0:1788581304.518738:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 87 00000100:00100000:3.0:1788581304.518749:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+10:13767:x1875462995421568:12345-192.168.201.13@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788581304.519167:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+10:13767:x1875462995421568:12345-192.168.201.13@tcp:503:mount.lustre.0 Request processed in 416us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581304.519177:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 87 00000100:00100000:1.0:1788581304.528763:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581304.528891:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995421696 00000100:00100000:0.0:1788581304.528907:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995421696 00000100:00100000:0.0:1788581304.529000:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 88 00000100:00100000:0.0:1788581304.529014:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+10:13791:x1875462995421696:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788581304.529715:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+10:13791:x1875462995421696:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 699us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581304.529733:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 88 00000100:00100000:0.0:1788581304.550412:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581304.550585:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995421824 00000100:00100000:1.0:1788581304.550601:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995421824 00000100:00100000:1.0:1788581304.550684:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 89 00000100:00100000:1.0:1788581304.550697:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+10:13791:x1875462995421824:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788581304.551077:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+10:13791:x1875462995421824:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 381us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581304.551087:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 89 00000100:00100000:2.0:1788581304.561104:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581304.562501:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995421952 00000100:00100000:1.0:1788581304.562517:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995421952 00000100:00100000:1.0:1788581304.562592:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:1.0:1788581304.562602:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2371:x1875462995421952:12345-192.168.201.13@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788581304.562651:0:14418:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c57f4789-35e1-4272-8645-acd484187c5c@192.168.201.13@tcp t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:1.0:1788581304.562704:0:14418:0:(genops.c:1385:class_connect()) connect: client c57f4789-35e1-4272-8645-acd484187c5c, cookie 0xf54e3944c2a7138f 00000004:00100000:1.0:1788581304.562739:0:14418:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788581304.562745:0:14418:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788581304.680557:0:14418:0:(import.c:65:import_set_state_nolock()) ffff91907fcac000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581304.680626:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+6:2371:x1875462995421952:12345-192.168.201.13@tcp:38:mount.lustre.0 Request processed in 118024us (119535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581304.680635:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:2.0:1788581304.685890:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581304.685938:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581304.686158:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995422208 00000100:00100000:1.0:1788581304.686167:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995422208 00000100:00100000:1.0:1788581304.686278:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995422080 00000100:00100000:1.0:1788581304.686281:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995422080 00000100:00080000:2.0:1788581304.686312:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581304.686780:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:3.0:1788581304.686796:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+7:13767:x1875462995422208:12345-192.168.201.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788581304.686841:0:14418:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788581304.686995:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+7:13767:x1875462995422208:12345-192.168.201.13@tcp:41:mount.lustre.0 Request processed in 203us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581304.687160:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:3.0:1788581304.687183:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:3.0:1788581304.687190:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+6:0:x1875462995422080:12345-192.168.201.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788581304.687206:0:14418:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788581304.687231:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+6:0:x1875462995422080:12345-192.168.201.13@tcp:41:mount.lustre.0 Request processed in 42us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581304.687237:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:1.0:1788581304.690393:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581304.690491:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995422336 00000100:00100000:2.0:1788581304.690501:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995422336 00000100:00100000:2.0:1788581304.690593:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:2.0:1788581304.690603:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c57f4789-35e1-4272-8645-acd484187c5c+6:13767:x1875462995422336:12345-192.168.201.13@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788581304.690685:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c57f4789-35e1-4272-8645-acd484187c5c+6:13767:x1875462995422336:12345-192.168.201.13@tcp:40:mount.lustre.0 Request processed in 84us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581304.690691:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:2.0:1788581304.699280:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581304.699326:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581304.699466:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581304.701160:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995422720 00000100:00100000:0.0:1788581304.701176:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995422720 00000100:00100000:0.0:1788581304.701270:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:0.0:1788581304.701283:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c57f4789-35e1-4272-8645-acd484187c5c+6:13767:x1875462995422720:12345-192.168.201.13@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788581304.701867:0:14419:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 502us 00000100:00100000:3.0:1788581304.708168:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995422464 00000100:00100000:3.0:1788581304.708183:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995422464 00000100:00100000:3.0:1788581304.708224:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995422592 00000100:00100000:3.0:1788581304.708227:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995422592 00000100:00100000:3.0:1788581304.708259:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:3.0:1788581304.708269:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2371:x1875462995422464:12345-192.168.201.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788581304.708302:0:15102:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c57f4789-35e1-4272-8645-acd484187c5c@192.168.201.13@tcp t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:3.0:1788581304.708334:0:15102:0:(genops.c:1385:class_connect()) connect: client c57f4789-35e1-4272-8645-acd484187c5c, cookie 0xf54e3944c2a71396 00002000:00100000:3.0:1788581304.708344:0:15102:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c57f4789-35e1-4272-8645-acd484187c5c/ffff919066df4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788581304.708355:0:15102:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788581304.708668:0:15102:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788581304.708699:0:15102:0:(import.c:65:import_set_state_nolock()) ffff919066df7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581304.708771:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c57f4789-35e1-4272-8645-acd484187c5c+6:2371:x1875462995422464:12345-192.168.201.13@tcp:8:mount.lustre.0 Request processed in 501us (9501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581304.708778:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:3.0:1788581304.708798:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:3.0:1788581304.708817:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2371:x1875462995422592:12345-192.168.201.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788581304.708832:0:15102:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c57f4789-35e1-4272-8645-acd484187c5c@192.168.201.13@tcp t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:3.0:1788581304.708848:0:15102:0:(genops.c:1385:class_connect()) connect: client c57f4789-35e1-4272-8645-acd484187c5c, cookie 0xf54e3944c2a7139d 00002000:00100000:3.0:1788581304.708854:0:15102:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c57f4789-35e1-4272-8645-acd484187c5c/ffff919066df3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788581304.708869:0:15102:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788581304.709005:0:15102:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788581304.709019:0:15102:0:(import.c:65:import_set_state_nolock()) ffff919066df0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581304.709043:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c57f4789-35e1-4272-8645-acd484187c5c+6:2371:x1875462995422592:12345-192.168.201.13@tcp:8:mount.lustre.0 Request processed in 225us (9716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581304.709049:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00000004:00200000:1.0:1788581304.736154:0:14419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788581304.736567:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c57f4789-35e1-4272-8645-acd484187c5c+6:13767:x1875462995422720:12345-192.168.201.13@tcp:33:mount.lustre.0 Request processed in 35282us (37095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581304.736583:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:2.0:1788581304.940957:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581304.941184:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995422848 00000100:00100000:0.0:1788581304.941196:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995422848 00000100:00100000:0.0:1788581304.941294:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:0.0:1788581304.941305:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+6:13812:x1875462995422848:12345-192.168.201.13@tcp:101:mkdir.0 00010000:00010000:0.0:1788581304.941329:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581304.941356:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d600/0xf54e3944c2a713a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9432 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581304.941436:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7dc00/0xf54e3944c2a713ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581304.941451:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7dc00/0xf54e3944c2a713ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581304.941466:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7dc00/0xf54e3944c2a713ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581304.941517:0:14416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788581304.941521:0:14416:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788581304.941557:0:14416:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7dc00/0xf54e3944c2a713ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581304.941586:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d600/0xf54e3944c2a713a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9432 expref: 8 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581304.941606:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7dc00/0xf54e3944c2a713ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9432 expref: 7 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581304.941616:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91904995aa00) 00010000:00010000:0.0:1788581304.941619:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581304.941622:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919075b7dc00, rc 0) 00000100:00100000:0.0:1788581304.941675:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+7:13812:x1875462995422848:12345-192.168.201.13@tcp:101:mkdir.0 Request processed in 372us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581304.941682:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00010000:00010000:1.0:1788581305.327446:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581306.351686:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581306.839366:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581306.839478:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995422976 00000100:00100000:1.0:1788581306.839489:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995422976 00000100:00100000:1.0:1788581306.839617:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:1.0:1788581306.839631:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c57f4789-35e1-4272-8645-acd484187c5c+7:13864:x1875462995422976:12345-192.168.201.13@tcp:41:lfs.0 00000004:00000024:1.0:1788581306.839676:0:14417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788581306.839770:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c57f4789-35e1-4272-8645-acd484187c5c+7:13864:x1875462995422976:12345-192.168.201.13@tcp:41:lfs.0 Request processed in 142us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581306.839777:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00080000:2.0:1788581306.843099:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581306.849291:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581306.849387:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995423104 00000100:00100000:0.0:1788581306.849397:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995423104 00000100:00100000:0.0:1788581306.849478:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:0.0:1788581306.849489:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c57f4789-35e1-4272-8645-acd484187c5c+6:13864:x1875462995423104:12345-192.168.201.13@tcp:13:lfs.0 00002000:00000024:0.0:1788581306.849525:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581306.849614:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c57f4789-35e1-4272-8645-acd484187c5c+6:13864:x1875462995423104:12345-192.168.201.13@tcp:13:lfs.0 Request processed in 126us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581306.849622:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00080000:2.0:1788581306.849936:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581306.852810:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581306.853232:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995423232 00000100:00100000:0.0:1788581306.853269:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995423232 00000100:00100000:0.0:1788581306.853404:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:0.0:1788581306.853417:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c57f4789-35e1-4272-8645-acd484187c5c+6:13864:x1875462995423232:12345-192.168.201.13@tcp:13:lfs.0 00002000:00000024:0.0:1788581306.853454:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581306.853547:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c57f4789-35e1-4272-8645-acd484187c5c+6:13864:x1875462995423232:12345-192.168.201.13@tcp:13:lfs.0 Request processed in 133us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581306.853555:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00080000:2.0:1788581306.853619:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581306.991634:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788581306.991668:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014293248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581306.991759:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581306.991858:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014293248 00000100:00100000:1.0:1788581306.991880:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014293248 00000100:00100000:1.0:1788581306.991964:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788581306.991967:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581306.991977:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3338:x1875463014293248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581306.992003:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581306.992058:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3338:x1875463014293248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581306.992065:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788581306.992149:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014293248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581306.993311:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014293760:0@lo:400:kworker.0 00000100:00100000:0.0:1788581306.993363:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581306.993393:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581306.993400:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3339:1875463014293632:0@lo:400:kworker.0 00000100:00100000:0.0:1788581306.993421:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581306.993448:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014293760 00000100:00100000:0.0:1788581306.993455:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014293760 00000100:00100000:0.0:1788581306.993507:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014293632 00000100:00100000:0.0:1788581306.993511:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014293632 00000100:00100000:0.0:1788581306.993545:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788581306.993553:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014293760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581306.993598:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014293760:12345-0@lo:400:kworker.0 Request processed in 45us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581306.993604:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788581306.993618:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788581306.993623:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581306.993625:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3339:x1875463014293632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581306.993661:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3339:x1875463014293632:12345-0@lo:400:kworker.0 Request processed in 37us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581306.993680:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788581306.993722:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3339:1875463014293632:0@lo:400:kworker.0 00000100:00100000:0.0:1788581306.993737:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014293760:0@lo:400:kworker.0 00000100:00100000:1.0:1788581306.993950:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3340:1875463014293376:0@lo:400:kworker.0 00000100:00100000:1.0:1788581306.993989:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581306.994031:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014293888:0@lo:400:kworker.0 00000100:00100000:1.0:1788581306.994053:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581306.994080:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581306.994086:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014293504:0@lo:400:kworker.0 00000100:00100000:1.0:1788581306.994110:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581306.994142:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014293504 00000100:00100000:1.0:1788581306.994147:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014293504 00000100:00100000:1.0:1788581306.994183:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581306.994190:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014293504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581306.994224:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014293504:12345-0@lo:400:kworker.0 Request processed in 35us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581306.994230:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788581306.994262:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581306.994288:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014293504:0@lo:400:kworker.0 00000100:00100000:1.0:1788581306.994309:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014293888 00000100:00100000:1.0:1788581306.994312:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014293888 00000100:00100000:1.0:1788581306.994339:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581306.994345:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014293888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581306.994387:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014293888:12345-0@lo:400:kworker.0 Request processed in 42us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581306.994393:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788581306.994407:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581306.994423:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014293888:0@lo:400:kworker.0 00000100:00100000:0.0:1788581306.994946:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014293376 00000100:00100000:0.0:1788581306.994952:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014293376 00000100:00100000:0.0:1788581306.994987:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788581306.994995:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:3340:x1875463014293376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581306.995094:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:3340:x1875463014293376:12345-0@lo:400:kworker.0 Request processed in 100us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581306.995101:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788581306.995142:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3340:1875463014293376:0@lo:400:kworker.0 00000100:00100000:1.0:1788581307.054975:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581307.055139:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995423360 00000100:00100000:3.0:1788581307.055150:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995423360 00000100:00100000:3.0:1788581307.055197:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 91 00000100:00100000:3.0:1788581307.055207:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+10:13898:x1875462995423360:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788581307.055223:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581307.055240:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821ce800/0xf54e3944c2a713b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9439 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581307.055289:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821ce800/0xf54e3944c2a713b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9439 expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581307.055300:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821ce800/0xf54e3944c2a713b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9439 expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581307.055317:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce800, rc 0) 00000100:00100000:3.0:1788581307.055390:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+11:13898:x1875462995423360:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 184us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581307.055398:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 91 00000100:00100000:3.0:1788581307.065961:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581307.066025:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995423488 00000100:00100000:1.0:1788581307.066037:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995423488 00000100:00100000:1.0:1788581307.066093:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 92 00000100:00100000:1.0:1788581307.066104:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+11:13898:x1875462995423488:12345-192.168.201.13@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788581307.066620:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+11:13898:x1875462995423488:12345-192.168.201.13@tcp:501:mount.lustre.0 Request processed in 515us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581307.066630:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 92 00000100:00100000:0.0:1788581307.074946:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581307.076520:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995423616 00000100:00100000:2.0:1788581307.076533:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995423616 00000100:00100000:2.0:1788581307.076596:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 93 00000100:00100000:2.0:1788581307.076608:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+11:13898:x1875462995423616:12345-192.168.201.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788581307.076825:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+11:13898:x1875462995423616:12345-192.168.201.13@tcp:503:mount.lustre.0 Request processed in 219us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581307.076834:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 93 00000100:00100000:2.0:1788581307.093114:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581307.093375:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995423744 00000100:00100000:3.0:1788581307.093385:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995423744 00000100:00100000:3.0:1788581307.093442:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 94 00000100:00100000:3.0:1788581307.093453:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+11:13903:x1875462995423744:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788581307.093756:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+11:13903:x1875462995423744:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 304us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581307.093764:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 94 00000100:00100000:0.0:1788581307.110483:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581307.110557:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995423872 00000100:00100000:3.0:1788581307.110568:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995423872 00000100:00100000:3.0:1788581307.110631:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 95 00000100:00100000:3.0:1788581307.110652:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+11:13903:x1875462995423872:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788581307.110915:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+11:13903:x1875462995423872:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 266us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581307.110925:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 95 00000001:00100000:3.0:1788581307.116403:0:7696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788581307.116422:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788581307.116434:0:7696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c57f4789-35e1-4272-8645-acd484187c5c 00000100:00100000:3.0:1788581307.125026:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581307.125291:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995424000 00000100:00100000:2.0:1788581307.125301:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995424000 00000100:00100000:2.0:1788581307.125355:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 96 00000100:00100000:2.0:1788581307.125363:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+11:13898:x1875462995424000:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788581307.125377:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581307.125390:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91906cb62200/0xf54e3944c2a713b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9463 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581307.125413:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91906cb62200/0xf54e3944c2a713b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9463 expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581307.125420:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91906cb62200/0xf54e3944c2a713b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9463 expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581307.125426:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91906cb62200, rc 0) 00000100:00100000:2.0:1788581307.125532:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+12:13898:x1875462995424000:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 169us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581307.125537:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 96 00000100:00100000:0.0:1788581307.138374:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581307.138464:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995424128 00000100:00100000:3.0:1788581307.138486:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995424128 00000100:00100000:3.0:1788581307.138543:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 97 00000100:00100000:3.0:1788581307.138554:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+12:13898:x1875462995424128:12345-192.168.201.13@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788581307.138582:0:14411:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788581307.138601:0:14411:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788581307.138606:0:14411:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788581307.138610:0:14411:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788581307.138612:0:14411:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788581307.140520:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+12:13898:x1875462995424128:12345-192.168.201.13@tcp:256:mount.lustre.0 Request processed in 1958us (2148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581307.140532:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 97 00000100:00100000:1.0:1788581307.144566:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581307.145045:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995424256 00000100:00100000:2.0:1788581307.145068:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995424256 00000100:00100000:2.0:1788581307.145125:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 98 00000100:00100000:2.0:1788581307.145148:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+12:13898:x1875462995424256:12345-192.168.201.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788581307.145166:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581307.145184:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91906cb62e00/0xf54e3944c2a713c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d946a expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581307.145213:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91906cb62e00/0xf54e3944c2a713c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d946a expref: 13 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581307.145225:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91906cb62e00/0xf54e3944c2a713c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d946a expref: 13 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581307.145236:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91906cb62e00, rc 0) 00000100:00100000:2.0:1788581307.145662:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:13898:x1875462995424256:12345-192.168.201.13@tcp:101:mount.lustre.0 Request processed in 526us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581307.145670:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 98 00000100:00100000:2.0:1788581307.152299:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581307.152574:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995424384 00000100:00100000:3.0:1788581307.152585:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995424384 00000100:00100000:3.0:1788581307.152636:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 99 00000100:00100000:3.0:1788581307.152646:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:13898:x1875462995424384:12345-192.168.201.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788581307.152979:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:13898:x1875462995424384:12345-192.168.201.13@tcp:501:mount.lustre.0 Request processed in 333us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581307.152988:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 99 00000100:00100000:0.0:1788581307.157935:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581307.158082:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995424512 00000100:00100000:2.0:1788581307.158093:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995424512 00000100:00100000:2.0:1788581307.158199:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 100 00000100:00100000:2.0:1788581307.158211:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:13898:x1875462995424512:12345-192.168.201.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788581307.158977:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:13898:x1875462995424512:12345-192.168.201.13@tcp:503:mount.lustre.0 Request processed in 767us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581307.158987:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 100 00000100:00100000:1.0:1788581307.163764:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581307.164029:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995424640 00000100:00100000:0.0:1788581307.164040:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995424640 00000100:00100000:0.0:1788581307.164100:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 101 00000100:00100000:0.0:1788581307.164111:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:13907:x1875462995424640:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788581307.164730:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:13907:x1875462995424640:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 619us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581307.164739:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 101 00000100:00100000:2.0:1788581307.177719:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581307.178130:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995424768 00000100:00100000:3.0:1788581307.178149:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995424768 00000100:00100000:3.0:1788581307.178213:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 102 00000100:00100000:3.0:1788581307.178224:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919072372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:13907:x1875462995424768:12345-192.168.201.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788581307.180410:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919072372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:13907:x1875462995424768:12345-192.168.201.13@tcp:502:llog_process_th.0 Request processed in 2179us (2692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581307.180422:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 102 00000100:00100000:0.0:1788581307.190405:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581307.193214:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995424896 00000100:00100000:1.0:1788581307.193292:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995424896 00000100:00100000:1.0:1788581307.193356:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:1.0:1788581307.193365:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2371:x1875462995424896:12345-192.168.201.13@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788581307.193395:0:14417:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b18916b8-1f25-41d8-9a9b-e15210a2edd6@192.168.201.13@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:1.0:1788581307.193451:0:14417:0:(genops.c:1385:class_connect()) connect: client b18916b8-1f25-41d8-9a9b-e15210a2edd6, cookie 0xf54e3944c2a713c7 00000004:00100000:1.0:1788581307.193484:0:14417:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788581307.193630:0:14417:0:(import.c:65:import_set_state_nolock()) ffff91905801a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788581307.193719:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:2371:x1875462995424896:12345-192.168.201.13@tcp:38:mount.lustre.0 Request processed in 353us (3325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581307.193728:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:1.0:1788581307.212808:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581307.212852:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581307.212942:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995425152 00000100:00100000:3.0:1788581307.212965:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995425152 00000100:00100000:3.0:1788581307.213036:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995425024 00000100:00100000:3.0:1788581307.213040:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995425024 00000100:00100000:3.0:1788581307.213059:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:3.0:1788581307.213068:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+7:13898:x1875462995425152:12345-192.168.201.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788581307.213100:0:14417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788581307.213165:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+7:13898:x1875462995425152:12345-192.168.201.13@tcp:41:mount.lustre.0 Request processed in 97us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581307.213173:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:3.0:1788581307.213191:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:3.0:1788581307.213199:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:0:x1875462995425024:12345-192.168.201.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788581307.213211:0:14417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788581307.213233:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:0:x1875462995425024:12345-192.168.201.13@tcp:41:mount.lustre.0 Request processed in 35us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581307.213240:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00080000:1.0:1788581307.213595:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581307.218754:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581307.218821:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995425280 00000100:00100000:3.0:1788581307.218832:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995425280 00000100:00100000:3.0:1788581307.218894:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:3.0:1788581307.218914:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:13898:x1875462995425280:12345-192.168.201.13@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788581307.219006:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:13898:x1875462995425280:12345-192.168.201.13@tcp:40:mount.lustre.0 Request processed in 103us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581307.219014:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:2.0:1788581307.228667:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581307.228715:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581307.228752:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581307.228963:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995425664 00000100:00100000:0.0:1788581307.228973:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995425664 00000100:00100000:0.0:1788581307.229031:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:0.0:1788581307.229041:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:13898:x1875462995425664:12345-192.168.201.13@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788581307.229145:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788581307.229226:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:13898:x1875462995425664:12345-192.168.201.13@tcp:33:mount.lustre.0 Request processed in 186us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581307.229235:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:3.0:1788581307.229638:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995425408 00000100:00100000:3.0:1788581307.229653:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995425408 00000100:00100000:3.0:1788581307.229710:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995425536 00000100:00100000:3.0:1788581307.229713:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995425536 00000100:00100000:3.0:1788581307.229747:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:3.0:1788581307.229756:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2371:x1875462995425408:12345-192.168.201.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788581307.229791:0:15102:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b18916b8-1f25-41d8-9a9b-e15210a2edd6@192.168.201.13@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:3.0:1788581307.229829:0:15102:0:(genops.c:1385:class_connect()) connect: client b18916b8-1f25-41d8-9a9b-e15210a2edd6, cookie 0xf54e3944c2a713ce 00002000:00100000:3.0:1788581307.229843:0:15102:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b18916b8-1f25-41d8-9a9b-e15210a2edd6/ffff919066df1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788581307.229857:0:15102:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788581307.231686:0:15102:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788581307.231753:0:15102:0:(import.c:65:import_set_state_nolock()) ffff919048b54000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581307.231855:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:2371:x1875462995425408:12345-192.168.201.13@tcp:8:mount.lustre.0 Request processed in 2097us (3197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581307.231868:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:2.0:1788581307.231917:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:2.0:1788581307.231933:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2371:x1875462995425536:12345-192.168.201.13@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788581307.232205:0:15102:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b18916b8-1f25-41d8-9a9b-e15210a2edd6@192.168.201.13@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1788581307.232283:0:15102:0:(genops.c:1385:class_connect()) connect: client b18916b8-1f25-41d8-9a9b-e15210a2edd6, cookie 0xf54e3944c2a713d5 00002000:00100000:2.0:1788581307.232298:0:15102:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b18916b8-1f25-41d8-9a9b-e15210a2edd6/ffff919048b51000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788581307.232312:0:15102:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788581307.235124:0:15102:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788581307.235184:0:15102:0:(import.c:65:import_set_state_nolock()) ffff919048b57000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581307.235302:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:2371:x1875462995425536:12345-192.168.201.13@tcp:8:mount.lustre.0 Request processed in 3372us (6582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581307.235316:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00010000:00010000:1.0:1788581307.376086:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581307.523353:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581307.524343:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995425792 00000100:00100000:2.0:1788581307.524364:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995425792 00000100:00100000:2.0:1788581307.524463:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:2.0:1788581307.524476:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:13928:x1875462995425792:12345-192.168.201.13@tcp:101:mkdir.0 00010000:00010000:2.0:1788581307.524506:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581307.524541:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63000/0xf54e3944c2a713dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9494 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581307.524684:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a713e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581307.524701:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a713e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581307.524716:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a713e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581307.524765:0:14416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788581307.524769:0:14416:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788581307.524815:0:14416:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a713e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581307.524845:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63000/0xf54e3944c2a713dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9494 expref: 8 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581307.524867:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a713e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9494 expref: 7 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581307.524877:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91904995aa00) 00010000:00010000:2.0:1788581307.524880:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788581307.524884:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91906cb63200, rc 0) 00000100:00100000:2.0:1788581307.524983:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b18916b8-1f25-41d8-9a9b-e15210a2edd6+7:13928:x1875462995425792:12345-192.168.201.13@tcp:101:mkdir.0 Request processed in 510us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581307.524991:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:2.0:1788581308.016556:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014294016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581308.016677:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581308.017486:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014294016 00000100:00100000:1.0:1788581308.019849:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014294016 00000100:00080000:0.0:1788581308.020754:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581308.020840:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788581308.020862:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014294016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581308.021225:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581308.025143:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014294016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4273us (8448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581308.025164:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788581308.025483:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014294016:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788581308.113493:0:6750:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b18916b8-1f25-41d8-9a9b-e15210a2edd6 00000001:00100000:3.0:1788581308.113508:0:6750:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c57f4789-35e1-4272-8645-acd484187c5c 00010000:00010000:3.0:1788581308.399462:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581309.425354:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788581309.873778:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1788581310.120968:0:5899:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c57f4789-35e1-4272-8645-acd484187c5c 00000001:00100000:2.0:1788581310.120993:0:5899:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b18916b8-1f25-41d8-9a9b-e15210a2edd6 00010000:00010000:3.0:1788581310.464442:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788581310.556037:0:16378:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788581311.471458:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581312.111489:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014294144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581312.111575:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581312.111641:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014294400:0@lo:400:kworker.0 00000100:00100000:3.0:1788581312.111658:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3338:1875463014294656:0@lo:400:kworker.0 00000100:00100000:3.0:1788581312.111693:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581312.111734:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788581312.111741:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3338:1875463014294272:0@lo:400:kworker.0 00000100:00100000:0.0:1788581312.111760:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581312.111780:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581312.111793:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907be15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014294912:0@lo:400:kworker.0 00000100:00100000:3.0:1788581312.111812:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907be17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014294784:0@lo:400:kworker.0 00000100:00100000:0.0:1788581312.111833:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581312.111856:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581312.111863:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014294528:0@lo:400:kworker.0 00000100:00100000:0.0:1788581312.111886:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581312.111918:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014294400 00000100:00100000:0.0:1788581312.111926:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014294400 00000100:00100000:0.0:1788581312.111987:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014294528 00000100:00100000:0.0:1788581312.111991:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014294528 00000100:00100000:1.0:1788581312.112001:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581312.112015:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014294400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581312.112015:0:15099:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788581312.112026:0:15099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788581312.112048:0:15100:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788581312.112059:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788581312.112069:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014294528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581312.112092:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014294400:12345-0@lo:400:kworker.0 Request processed in 78us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581312.112100:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581312.112109:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014294528:12345-0@lo:400:kworker.0 Request processed in 42us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581312.112118:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788581312.112141:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581312.112160:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581312.112186:0:3340:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788581312.112206:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014294528:0@lo:400:kworker.0 00000100:00100000:0.0:1788581312.112217:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014294400:0@lo:400:kworker.0 00000100:00100000:3.0:1788581312.112323:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581312.112363:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014294144 00000100:00100000:3.0:1788581312.112367:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014294144 00000100:00100000:0.0:1788581312.112390:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014294656 00000100:00100000:0.0:1788581312.112396:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014294656 00000100:00100000:3.0:1788581312.112400:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581312.112411:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014294144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581312.112442:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788581312.112491:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014294144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581312.112498:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581312.112518:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014294912 00000100:00100000:3.0:1788581312.112522:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014294912 00000100:00100000:0.0:1788581312.112540:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014294784 00000100:00100000:0.0:1788581312.112545:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014294784 00000100:00100000:3.0:1788581312.112550:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788581312.112559:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3338:x1875463014294656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581312.112571:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788581312.112579:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788581312.112597:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3338:x1875463014294656:12345-0@lo:400:kworker.0 Request processed in 41us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581312.112604:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788581312.112615:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788581312.112620:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014294912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581312.112658:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3340:x1875463014294912:12345-0@lo:400:kworker.0 Request processed in 38us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581312.112664:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788581312.112675:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788581312.112680:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014294784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581312.112705:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3338:x1875463014294784:12345-0@lo:400:kworker.0 Request processed in 25us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581312.112710:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788581312.112790:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907be15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3340:1875463014294912:0@lo:400:kworker.0 00000100:00080000:3.0:1788581312.115206:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581312.115365:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014294272 00000100:00100000:0.0:1788581312.115380:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014294272 00000100:00100000:0.0:1788581312.115447:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788581312.115457:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:3338:x1875463014294272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581312.115546:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:3338:x1875463014294272:12345-0@lo:400:kworker.0 Request processed in 90us (3766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581312.115554:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788581312.115611:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3338:1875463014294272:0@lo:400:kworker.0 00000100:00100000:0.0:1788581312.115630:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907be17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3338:1875463014294784:0@lo:400:kworker.0 00000100:00100000:0.0:1788581312.115643:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3338:1875463014294656:0@lo:400:kworker.0 00000100:00100000:0.0:1788581312.115674:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014294144:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788581312.228461:0:7696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b18916b8-1f25-41d8-9a9b-e15210a2edd6 00000100:00100000:3.0:1788581312.390881:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581312.390933:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581312.390965:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581312.390988:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581312.391008:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581312.391027:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581312.391084:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581312.391115:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995425920 00000100:00100000:3.0:1788581312.391125:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995425920 00000100:00100000:3.0:1788581312.391173:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 104 00000100:00100000:3.0:1788581312.391185:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:2372:x1875462995425920:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581312.391290:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:2372:x1875462995425920:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 107us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581312.391298:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 104 00000100:00100000:3.0:1788581312.391332:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995426304 00000100:00100000:3.0:1788581312.391336:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995426304 00000100:00100000:3.0:1788581312.391367:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995426176 00000100:00100000:3.0:1788581312.391370:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995426176 00000100:00100000:3.0:1788581312.391382:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995426560 00000100:00100000:3.0:1788581312.391384:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995426560 00000100:00100000:3.0:1788581312.391397:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995426688 00000100:00100000:3.0:1788581312.391399:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995426688 00000100:00100000:3.0:1788581312.391411:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:3.0:1788581312.391418:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c57f4789-35e1-4272-8645-acd484187c5c+5:2373:x1875462995426304:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581312.391446:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c57f4789-35e1-4272-8645-acd484187c5c+5:2373:x1875462995426304:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 28us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581312.391452:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:3.0:1788581312.391464:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:3.0:1788581312.391469:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c57f4789-35e1-4272-8645-acd484187c5c+5:2372:x1875462995426176:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581312.391491:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c57f4789-35e1-4272-8645-acd484187c5c+5:2372:x1875462995426176:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 22us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581312.391497:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:3.0:1788581312.391507:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:3.0:1788581312.391520:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b18916b8-1f25-41d8-9a9b-e15210a2edd6+5:2373:x1875462995426560:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581312.391543:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b18916b8-1f25-41d8-9a9b-e15210a2edd6+5:2373:x1875462995426560:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 24us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581312.391549:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:3.0:1788581312.391561:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:3.0:1788581312.391567:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b18916b8-1f25-41d8-9a9b-e15210a2edd6+5:2372:x1875462995426688:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581312.391589:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b18916b8-1f25-41d8-9a9b-e15210a2edd6+5:2372:x1875462995426688:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 22us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581312.391594:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:3.0:1788581312.391615:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995426048 00000100:00100000:3.0:1788581312.391619:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995426048 00000100:00100000:3.0:1788581312.391647:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995426432 00000100:00100000:3.0:1788581312.391650:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995426432 00000100:00100000:3.0:1788581312.391669:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:3.0:1788581312.391676:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c57f4789-35e1-4272-8645-acd484187c5c+6:2373:x1875462995426048:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581312.391704:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c57f4789-35e1-4272-8645-acd484187c5c+6:2373:x1875462995426048:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 29us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581312.391710:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:3.0:1788581312.391723:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:3.0:1788581312.391729:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:2372:x1875462995426432:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581312.391751:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:2372:x1875462995426432:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 22us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581312.391757:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00080000:3.0:1788581312.391915:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581312.391921:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581312.391929:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788581312.503199:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581313.135885:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014295040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788581313.135973:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581313.136155:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014295040 00000100:00100000:2.0:1788581313.136164:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014295040 00000100:00100000:2.0:1788581313.136222:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788581313.136233:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014295040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581313.136291:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581313.136340:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014295040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581313.136347:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788581313.136388:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014295040:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788581313.519524:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581314.545944:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788581314.565737:0:16531:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda6c413b0 20000000:00000080:1.0:1788581314.565755:0:16531:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff918f42314000 uarg=0000000000000000 20000000:01000000:1.0:1788581314.565805:0:16531:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788581314.565812:0:16531:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788581314.565822:0:16531:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788581314.566982:0:16532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788581314.567199:0:16531:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788581314.573772:0:16531:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788581314.573813:0:16531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919044ca9400/0xf54e3944c2a713ea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581314.573898:0:16531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a710e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a710da expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581314.573907:0:16531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919044ca8800/0xf54e3944c2a7112e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a71127 expref: 18 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581314.573915:0:16531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a71262 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a7125b expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581314.573925:0:16531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919075b7c600/0xf54e3944c2a71388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9408 expref: 12 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581314.573932:0:16531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91906cb62e00/0xf54e3944c2a713c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d946a expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581314.573939:0:16531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919044ca9400/0xf54e3944c2a713ea lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581314.573982:0:16531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91906cb62e00/0xf54e3944c2a713c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d946a expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581314.573998:0:16531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91906cb62e00/0xf54e3944c2a713c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d946a expref: 12 pid: 14410 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581314.574014:0:16531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875463014295168:192.168.201.13@tcp:104: 00010000:00010000:1.0:1788581314.574237:0:16531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919075b7c600/0xf54e3944c2a71388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9408 expref: 12 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581314.574285:0:16531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919075b7c600/0xf54e3944c2a71388 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9408 expref: 12 pid: 14412 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581314.574294:0:16531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875463014295296:192.168.201.13@tcp:104: 00010000:00010000:1.0:1788581314.574336:0:16531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a71262 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a7125b expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581314.574345:0:16531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a71262 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a7125b expref: 18 pid: 14412 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581314.574354:0:16531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875463014295424:0@lo:104: 00000100:00100000:1.0:1788581314.574390:0:16531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581314.574424:0:16531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919044ca8800/0xf54e3944c2a7112e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a71127 expref: 18 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581314.574432:0:16531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919044ca8800/0xf54e3944c2a7112e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a71127 expref: 18 pid: 14410 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581314.574439:0:16531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875463014295552:0@lo:104: 00000100:00100000:1.0:1788581314.574454:0:16531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788581314.574469:0:16531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a710e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf54e3944c2a710da expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581314.574476:0:16531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a710e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf54e3944c2a710da expref: 18 pid: 14412 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581314.574483:0:16531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875463014295680:0@lo:104: 00000100:00100000:1.0:1788581314.574523:0:16531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581314.574532:0:16531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190467e5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788581314.574610:0:14400:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788581314.574623:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014295424 00000100:00100000:0.0:1788581314.574634:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014295424 00000100:00100000:0.0:1788581314.574668:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014295552 00000100:00100000:0.0:1788581314.574670:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014295552 00000100:00100000:0.0:1788581314.574678:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014295680 00000100:00100000:0.0:1788581314.574680:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014295680 00000100:00100000:0.0:1788581314.574691:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788581314.574698:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+5:16531:x1875463014295424:12345-0@lo:104: 00010000:00010000:0.0:1788581314.574709:0:14400:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff919044ca9800/0xf54e3944c2a7125b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a71262 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.574765:0:14400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581314.574771:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+5:16531:x1875463014295424:12345-0@lo:104: Request processed in 73us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581314.574789:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788581314.574806:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581314.574811:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+4:16531:x1875463014295552:12345-0@lo:104: 00010000:00010000:0.0:1788581314.574818:0:14400:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a71127 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a7112e expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.574859:0:14400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788581314.574864:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+4:16531:x1875463014295552:12345-0@lo:104: Request processed in 53us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581314.574869:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581314.574880:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581314.574885:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048d22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+3:16531:x1875463014295680:12345-0@lo:104: 00010000:00010000:0.0:1788581314.574892:0:14400:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.113@tcp lock: ffff91906cb62600/0xf54e3944c2a710da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a710e1 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.574912:0:14400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788581314.574922:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048d22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+3:16531:x1875463014295680:12345-0@lo:104: Request processed in 37us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581314.574927:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788581314.574966:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788581314.574972:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff919044ca9800/0xf54e3944c2a7125b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a71262 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.574981:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9800 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:0.0:1788581314.574985:0:14406:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff919044ca9800/0xf54e3944c2a7125b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a71262 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.574994:0:14406:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff919044ca9800/0xf54e3944c2a7125b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a71262 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581314.575001:0:14406:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff919044ca9800/0xf54e3944c2a7125b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a71262 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581314.575007:0:14406:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788581314.575032:0:14406:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff919044ca9800/0xf54e3944c2a7125b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a71262 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575038:0:14406:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581314.575056:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff919044ca9800/0xf54e3944c2a7125b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a71262 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575063:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff919044ca9800/0xf54e3944c2a7125b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a71262 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575076:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581314.575079:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a71127 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a7112e expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575094:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce200 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:0.0:1788581314.575097:0:14406:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a71127 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a7112e expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575104:0:14406:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a71127 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a7112e expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581314.575110:0:14406:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a71127 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a7112e expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581314.575126:0:14406:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788581314.575137:0:14406:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a71127 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a7112e expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575143:0:14406:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581314.575148:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a71127 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a7112e expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575155:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff9190821ce200/0xf54e3944c2a71127 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a7112e expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575164:0:14406:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581314.575167:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.113@tcp lock: ffff91906cb62600/0xf54e3944c2a710da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf54e3944c2a710e1 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575172:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb62600 already unused, calling callback (ffffffffc1cf0c20) 10000000:00010000:0.0:1788581314.575174:0:14406:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.113@tcp lock: ffff91906cb62600/0xf54e3944c2a710da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf54e3944c2a710e1 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575190:0:14406:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.113@tcp lock: ffff91906cb62600/0xf54e3944c2a710da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf54e3944c2a710e1 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581314.575197:0:14406:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.113@tcp lock: ffff91906cb62600/0xf54e3944c2a710da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf54e3944c2a710e1 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581314.575202:0:14406:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788581314.575211:0:14406:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.113@tcp lock: ffff91906cb62600/0xf54e3944c2a710da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a710e1 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575216:0:14406:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581314.575229:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.113@tcp lock: ffff91906cb62600/0xf54e3944c2a710da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a710e1 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575235:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.113@tcp lock: ffff91906cb62600/0xf54e3944c2a710da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf54e3944c2a710e1 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575275:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581314.575277:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581314.575279:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581314.575285:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581314.575302:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907be17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3338:1875463014295808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581314.575329:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581314.575350:0:3338:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581314.575355:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907be15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3338:1875463014295936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581314.575369:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581314.575390:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907be16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3340:1875463014296064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581314.575410:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581314.575445:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014295808 00000100:00100000:0.0:1788581314.575449:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014295808 00010000:00010000:0.0:1788581314.575467:0:14403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a71262 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a7125b expref: 19 pid: 14412 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581314.575479:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014295936 00000100:00100000:0.0:1788581314.575481:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014295936 00010000:00010000:0.0:1788581314.575489:0:14403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919044ca8800/0xf54e3944c2a7112e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a71127 expref: 20 pid: 14410 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581314.575497:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014296064 00000100:00100000:0.0:1788581314.575499:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014296064 00010000:00010000:0.0:1788581314.575506:0:14403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a710e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a710da expref: 21 pid: 14412 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581314.575515:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788581314.575520:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+21:3338:x1875463014295808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581314.575529:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581314.575534:0:14403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a71262 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a7125b expref: 21 pid: 14412 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575543:0:14403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a71262 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a7125b expref: 21 pid: 14412 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575556:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581314.575578:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+21:3338:x1875463014295808:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581314.575584:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788581314.575594:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581314.575599:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+20:3338:x1875463014295936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581314.575612:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581314.575616:0:14403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919044ca8800/0xf54e3944c2a7112e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a71127 expref: 20 pid: 14410 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575624:0:14403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919044ca8800/0xf54e3944c2a7112e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a71127 expref: 20 pid: 14410 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575632:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581314.575648:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+20:3338:x1875463014295936:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581314.575654:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581314.575664:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581314.575669:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:3340:x1875463014296064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788581314.575675:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581314.575678:0:14403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a710e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf54e3944c2a710da expref: 19 pid: 14412 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575686:0:14403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a710e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf54e3944c2a710da expref: 19 pid: 14412 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581314.575694:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581314.575710:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:3340:x1875463014296064:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581314.575716:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581314.575762:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907be16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3340:1875463014296064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581314.575798:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907be15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3338:1875463014295936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581314.575805:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907be17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3338:1875463014295808:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581314.575993:0:16531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a71262 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a7125b expref: 18 pid: 14412 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581314.576004:0:16531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875463014295424:0@lo:104: 00010000:00010000:1.0:1788581314.576014:0:16531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919044ca8800/0xf54e3944c2a7112e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a71127 expref: 17 pid: 14410 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581314.576021:0:16531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875463014295552:0@lo:104: 00010000:00010000:1.0:1788581314.576029:0:16531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91907bc22a00/0xf54e3944c2a710e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf54e3944c2a710da expref: 16 pid: 14412 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581314.576036:0:16531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875463014295680:0@lo:104: 00000100:00100000:2.0:1788581314.587683:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581314.587767:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581314.587855:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995426816 00000100:00100000:3.0:1788581314.587866:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995426816 00010000:00010000:3.0:1788581314.587907:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91906cb62e00/0xf54e3944c2a713c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d946a expref: 13 pid: 14410 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581314.587947:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995426944 00000100:00100000:3.0:1788581314.587950:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995426944 00010000:00010000:3.0:1788581314.587963:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919075b7c600/0xf54e3944c2a71388 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9408 expref: 14 pid: 14412 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581314.587978:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:3.0:1788581314.587987:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190768cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+14:2374:x1875462995426816:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788581314.587999:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581314.588004:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91906cb62e00/0xf54e3944c2a713c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d946a expref: 14 pid: 14410 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581314.588017:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91906cb62e00/0xf54e3944c2a713c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d946a expref: 14 pid: 14410 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581314.588037:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581314.588089:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190768cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+14:2374:x1875462995426816:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 103us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581314.588096:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:2.0:1788581314.588346:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:2.0:1788581314.588358:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43214380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+14:2374:x1875462995426944:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581314.588367:0:14402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581314.588372:0:14402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919075b7c600/0xf54e3944c2a71388 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9408 expref: 14 pid: 14412 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581314.588382:0:14402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919075b7c600/0xf54e3944c2a71388 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9408 expref: 14 pid: 14412 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581314.588394:0:14402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919044ca9400/0xf54e3944c2a713ea lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581314.588403:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca9400/0xf54e3944c2a713ea lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581314.588424:0:14402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919044ca9400/0xf54e3944c2a713ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581314.588431:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919044ca9400/0xf54e3944c2a713ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581314.588437:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919044ca9400/0xf54e3944c2a713ea lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581314.588444:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919044ca9400/0xf54e3944c2a713ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581314.588450:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9400 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:2.0:1788581314.588454:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919044ca9400/0xf54e3944c2a713ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581314.588462:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919044ca9400/0xf54e3944c2a713ea lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581314.588472:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919044ca9400/0xf54e3944c2a713ea lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581314.588482:0:14402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581314.588506:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43214380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+14:2374:x1875462995426944:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 153us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581314.588513:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00010000:00010000:1.0:1788581314.589563:0:16531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91906cb62e00/0xf54e3944c2a713c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d946a expref: 12 pid: 14410 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581314.589581:0:16531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875463014295168:192.168.201.13@tcp:104: 00010000:00010000:1.0:1788581314.589595:0:16531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919075b7c600/0xf54e3944c2a71388 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9408 expref: 11 pid: 14412 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581314.589604:0:16531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875463014295296:192.168.201.13@tcp:104: 00010000:00010000:1.0:1788581314.589635:0:16531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919044ca9400/0xf54e3944c2a713ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581314.589645:0:16531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919044ca9400/0xf54e3944c2a713ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581314.589652:0:16531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919044ca9400/0xf54e3944c2a713ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581314.589669:0:16531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919044ca9400/0xf54e3944c2a713ea lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581315.570234:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581316.040119:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581316.040283:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995427072 00000100:00100000:0.0:1788581316.040295:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995427072 00000100:00100000:0.0:1788581316.040370:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 105 00000100:00100000:0.0:1788581316.040381:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+11:13781:x1875462995427072:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581316.040398:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581316.040421:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919075b7c000/0xf54e3944c2a713f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d949b expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581316.040457:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919075b7c000/0xf54e3944c2a713f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d949b expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581316.040469:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919075b7c000/0xf54e3944c2a713f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d949b expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581316.040479:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919075b7c000, rc 0) 00000100:00100000:0.0:1788581316.040552:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+12:13781:x1875462995427072:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 Request processed in 173us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581316.040567:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 105 00000100:00100000:3.0:1788581316.043553:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581316.043716:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995427200 00000100:00100000:0.0:1788581316.043725:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995427200 00000100:00100000:0.0:1788581316.043799:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 106 00000100:00100000:0.0:1788581316.043809:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+12:13781:x1875462995427200:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581316.050098:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+12:13781:x1875462995427200:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 Request processed in 6277us (6541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581316.050116:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 106 00000100:00100000:2.0:1788581316.063340:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581316.063691:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995427328 00000100:00100000:1.0:1788581316.063703:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995427328 00000100:00100000:1.0:1788581316.063771:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 107 00000100:00100000:1.0:1788581316.063782:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+12:13781:x1875462995427328:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581316.064080:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+12:13781:x1875462995427328:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 Request processed in 299us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581316.064099:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 107 00000100:00100000:1.0:1788581316.088451:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581316.088694:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995427456 00000100:00100000:3.0:1788581316.088705:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995427456 00000100:00100000:3.0:1788581316.088774:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 108 00000100:00100000:3.0:1788581316.088786:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+12:13781:x1875462995427456:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581316.088806:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581316.088825:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821cfa00/0xf54e3944c2a713f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d94a2 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581316.088857:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821cfa00/0xf54e3944c2a713f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94a2 expref: 13 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581316.088868:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821cfa00/0xf54e3944c2a713f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94a2 expref: 13 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581316.088878:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cfa00, rc 0) 00000100:00100000:3.0:1788581316.088941:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:13781:x1875462995427456:12345-192.168.201.13@tcp:101:ll_cfg_requeue.0 Request processed in 157us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581316.089103:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 108 00000100:00100000:3.0:1788581316.093909:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581316.094005:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995427584 00000100:00100000:1.0:1788581316.094016:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995427584 00000100:00100000:1.0:1788581316.094074:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 109 00000100:00100000:1.0:1788581316.094086:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:13781:x1875462995427584:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581316.094422:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:13781:x1875462995427584:12345-192.168.201.13@tcp:501:ll_cfg_requeue.0 Request processed in 336us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581316.094431:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 109 00000100:00100000:0.0:1788581316.100189:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581316.102452:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995427712 00000100:00100000:3.0:1788581316.102470:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995427712 00000100:00100000:2.0:1788581316.102685:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 110 00000100:00100000:2.0:1788581316.102697:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:13781:x1875462995427712:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581316.102986:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:13781:x1875462995427712:12345-192.168.201.13@tcp:503:ll_cfg_requeue.0 Request processed in 289us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581316.102993:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 110 10000000:01000000:2.0:1788581316.207551:0:14414:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788581316.207559:0:14414:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91906be86000 from 10 10000000:01000000:2.0:1788581316.207564:0:14414:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788581316.207612:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62800/0xf54e3944c2a713ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581316.207623:0:14414:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91906cb62800/0xf54e3944c2a713ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581316.207634:0:14414:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91906cb62800/0xf54e3944c2a713ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581316.207674:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43217480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014296192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788581316.207921:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581316.208015:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c5ee300 going to sleep for 11 seconds 00000100:00100000:3.0:1788581316.208988:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014296192 00000100:00100000:3.0:1788581316.208996:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014296192 00000100:00100000:2.0:1788581316.209372:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788581316.209386:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+16:14414:x1875463014296192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581316.209403:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581316.209420:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91906cb63c00/0xf54e3944c2a71406 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a713ff expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581316.209449:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91906cb63c00/0xf54e3944c2a71406 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a713ff expref: 17 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581316.209460:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91906cb63c00/0xf54e3944c2a71406 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a713ff expref: 17 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581316.209477:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91906cb63c00, rc 0) 00000100:00100000:2.0:1788581316.209547:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:14414:x1875463014296192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581316.209638:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43217480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014296192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581316.209656:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91906cb62800/0xf54e3944c2a713ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71406 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581316.209675:0:14414:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91906cb62800/0xf54e3944c2a713ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a71406 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581316.209745:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014296320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581316.209792:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581316.209822:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff9190467e5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788581316.210327:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014296320 00000100:00100000:3.0:1788581316.210334:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014296320 00000100:00100000:2.0:1788581316.211069:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788581316.211217:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788581316.214274:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:14414:x1875463014296320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581316.214816:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:14414:x1875463014296320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 579us (5022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581316.214826:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788581316.214917:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014296320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581316.214974:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43215c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014296448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581316.215026:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581316.215067:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c5ee300 going to sleep for 11 seconds 00000100:00100000:1.0:1788581316.215087:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014296448 00000100:00100000:1.0:1788581316.215095:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014296448 00000100:00100000:1.0:1788581316.215144:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788581316.215153:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:14414:x1875463014296448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581316.215345:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:14414:x1875463014296448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581316.215353:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788581316.215354:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43215c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014296448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788581316.216441:0:16604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788581316.216500:0:14414:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788581316.216520:0:14414:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788581316.216531:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb62800/0xf54e3944c2a713ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71406 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581316.216542:0:14414:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91906cb62800/0xf54e3944c2a713ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71406 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581316.216553:0:14414:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788581316.216556:0:14414:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919050d45000 from 10 10000000:01000000:2.0:1788581316.216559:0:14414:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788581316.216661:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb63000/0xf54e3944c2a7140d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581316.216669:0:14414:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff91906cb63000/0xf54e3944c2a7140d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581316.216693:0:14414:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff91906cb63000/0xf54e3944c2a7140d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581316.216713:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43215c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014296576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788581316.216769:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581316.216839:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff91906c5ee300 going to sleep for 11 seconds 00000100:00100000:3.0:1788581316.216872:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014296576 00000100:00100000:3.0:1788581316.216880:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014296576 00000100:00100000:3.0:1788581316.216948:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788581316.216958:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+17:14414:x1875463014296576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581316.216970:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581316.216982:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190821cf800/0xf54e3944c2a71414 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a7140d expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581316.217003:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190821cf800/0xf54e3944c2a71414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a7140d expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581316.217011:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190821cf800/0xf54e3944c2a71414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a7140d expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581316.217029:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf800, rc 0) 00000100:00100000:3.0:1788581316.217076:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:14414:x1875463014296576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581316.217082:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788581316.217639:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43215c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014296576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581316.217656:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff91906cb63000/0xf54e3944c2a7140d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71414 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581316.217782:0:14414:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff91906cb63000/0xf54e3944c2a7140d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a71414 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581316.217851:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014296704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581316.217886:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581316.218005:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076c353c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581316.222903:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014296704 00000100:00100000:2.0:1788581316.222917:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014296704 00000100:00100000:2.0:1788581316.223904:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788581316.223922:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:14414:x1875463014296704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581316.224233:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:14414:x1875463014296704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (6344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581316.224260:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788581316.225537:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014296704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581316.225597:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014296832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581316.225660:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581316.226204:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff919076c353c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581316.226909:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014296832 00000100:00100000:3.0:1788581316.226919:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014296832 00000100:00100000:3.0:1788581316.226968:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788581316.226981:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:14414:x1875463014296832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581316.227238:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:14414:x1875463014296832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 259us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581316.227267:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788581316.227433:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907fc3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014296832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788581316.228394:0:16605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788581316.228621:0:14414:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788581316.228646:0:14414:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788581316.228657:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff91906cb63000/0xf54e3944c2a7140d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71414 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581316.228679:0:14414:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff91906cb63000/0xf54e3944c2a7140d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71414 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581316.228699:0:14414:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788581316.228702:0:14414:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919059822800 from 10 10000000:01000000:3.0:1788581316.228704:0:14414:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581316.228737:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a7141b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581316.228746:0:14414:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a7141b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581316.228780:0:14414:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a7141b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581316.228802:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014296960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581316.228856:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581316.228904:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff919050ace540 going to sleep for 11 seconds 00000100:00100000:1.0:1788581316.229076:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014296960 00000100:00100000:1.0:1788581316.229083:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014296960 00000100:00100000:1.0:1788581316.229117:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788581316.229125:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919049b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+18:14414:x1875463014296960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581316.229138:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581316.229158:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a71422 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf54e3944c2a7141b expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581316.229192:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a71422 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf54e3944c2a7141b expref: 19 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581316.229202:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919044ca9c00/0xf54e3944c2a71422 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf54e3944c2a7141b expref: 19 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581316.229211:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9c00, rc 0) 00000100:00100000:1.0:1788581316.229278:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919049b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:14414:x1875463014296960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581316.229285:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788581316.229412:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014296960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581316.229425:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a7141b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71422 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581316.229434:0:14414:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a7141b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf54e3944c2a71422 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581316.229491:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014297088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581316.229516:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581316.229545:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff919050ace540 going to sleep for 11 seconds 00000100:00100000:1.0:1788581316.229584:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014297088 00000100:00100000:1.0:1788581316.229587:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014297088 00000100:00100000:1.0:1788581316.229605:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788581316.229611:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:14414:x1875463014297088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581316.230019:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:14414:x1875463014297088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 406us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581316.230026:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788581316.231880:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014297088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581316.231936:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014297216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581316.232000:0:14414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581316.232070:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff919050ace540 going to sleep for 11 seconds 00000100:00100000:0.0:1788581316.232368:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014297216 00000100:00100000:0.0:1788581316.232375:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014297216 00000100:00100000:1.0:1788581316.232550:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788581316.232562:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:14414:x1875463014297216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581316.233356:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:14414:x1875463014297216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 793us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581316.233366:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788581316.233806:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c4ed75f-0e9f-4624-94e3-96119520d4d4:14414:1875463014297216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788581316.234504:0:16606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788581316.234565:0:14414:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788581316.234588:0:14414:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788581316.234606:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a7141b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71422 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581316.234616:0:14414:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.113@tcp lock: ffff9190821cee00/0xf54e3944c2a7141b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf54e3944c2a71422 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581316.600615:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581317.231710:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907be15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014297472:0@lo:400:kworker.0 00000100:00100000:3.0:1788581317.232299:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907be16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014297600:0@lo:400:kworker.0 00000100:00100000:3.0:1788581317.232395:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581317.232458:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014298112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581317.232482:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581317.232535:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014297600 00000100:00100000:3.0:1788581317.232544:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014297600 00000100:00100000:1.0:1788581317.232903:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907be14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014297728:0@lo:400:kworker.0 00000100:00100000:1.0:1788581317.232939:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581317.232978:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788581317.232985:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907be17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3340:1875463014297344:0@lo:400:kworker.0 00000100:00100000:1.0:1788581317.233026:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581317.233049:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907be17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014297856:0@lo:400:kworker.0 00000100:00100000:1.0:1788581317.233070:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581317.233124:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014297344 00000100:00100000:1.0:1788581317.233128:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014297344 00000100:00100000:1.0:1788581317.233163:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788581317.233173:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:3340:x1875463014297344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581317.233230:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:3340:x1875463014297344:12345-0@lo:400:kworker.0 Request processed in 58us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581317.233238:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788581317.233290:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014297728 00000100:00100000:1.0:1788581317.233294:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014297728 00000100:00100000:1.0:1788581317.233318:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014297856 00000100:00100000:1.0:1788581317.233321:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014297856 00000100:00100000:1.0:1788581317.233342:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788581317.233349:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014297728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581317.233382:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014297728:12345-0@lo:400:kworker.0 Request processed in 33us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581317.233388:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788581317.233400:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788581317.233406:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014297856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788581317.233430:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3340:x1875463014297856:12345-0@lo:400:kworker.0 Request processed in 25us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581317.233436:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788581317.233468:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907be17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3340:1875463014297344:0@lo:400:kworker.0 00000100:00100000:1.0:1788581317.233491:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907be17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3340:1875463014297856:0@lo:400:kworker.0 00000100:00100000:1.0:1788581317.233499:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907be14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014297728:0@lo:400:kworker.0 00000100:00100000:0.0:1788581317.233762:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581317.233923:0:3338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907be14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3338:1875463014297984:0@lo:400:kworker.0 00000100:00100000:0.0:1788581317.233953:0:3338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581317.233994:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014297472 00000100:00100000:2.0:1788581317.234120:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014298112 00000100:00100000:2.0:1788581317.234126:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014298112 00000100:00100000:2.0:1788581317.234168:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581317.234176:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3339:x1875463014298112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581317.234206:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581317.234283:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3339:x1875463014298112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581317.234289:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581317.234333:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014298112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581317.234388:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788581317.234397:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014297600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581317.234436:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014297600:12345-0@lo:400:kworker.0 Request processed in 42us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581317.234453:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788581317.234475:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581317.234480:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581317.234497:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907be16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014297600:0@lo:400:kworker.0 00000100:00100000:2.0:1788581317.234523:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014297984 00000100:00100000:2.0:1788581317.234526:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014297984 00000100:00100000:2.0:1788581317.234555:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788581317.234561:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3338:x1875463014297984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581317.234690:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014297472 00000100:00100000:0.0:1788581317.234723:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788581317.234730:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014297472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581317.234779:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3338:x1875463014297472:12345-0@lo:400:kworker.0 Request processed in 49us (1990us total) trans 0 rc 0/0 00000100:00080000:3.0:1788581317.234919:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581317.234922:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581317.235186:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788581317.235225:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907be15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3338:1875463014297472:0@lo:400:kworker.0 00000100:00100000:2.0:1788581317.235551:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3338:x1875463014297984:12345-0@lo:400:kworker.0 Request processed in 988us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581317.235559:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788581317.235758:0:3338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907be14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3338:1875463014297984:0@lo:400:kworker.0 00000100:00100000:1.0:1788581317.514215:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581317.514362:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581317.514531:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995427968 00000100:00100000:0.0:1788581317.514543:0:16416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995427968 00000100:00100000:0.0:1788581317.514626:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:0.0:1788581317.514638:0:16416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+6:2373:x1875462995427968:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581317.514716:0:16416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+6:2373:x1875462995427968:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 81us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581317.514724:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00080000:2.0:1788581317.515502:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581317.515610:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995427840 00000100:00100000:3.0:1788581317.515616:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995427840 00000100:00100000:3.0:1788581317.515702:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 121 00000100:00100000:3.0:1788581317.515711:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:2373:x1875462995427840:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581317.515787:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:2373:x1875462995427840:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 77us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581317.515794:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 121 00000100:00100000:1.0:1788581317.526493:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581317.526589:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581317.526668:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581317.526723:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995428224 00000100:00100000:2.0:1788581317.526743:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995428224 00000100:00100000:2.0:1788581317.526843:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995428480 00000100:00100000:2.0:1788581317.526847:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995428480 00000100:00100000:2.0:1788581317.526873:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:2.0:1788581317.526884:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c57f4789-35e1-4272-8645-acd484187c5c+5:2372:x1875462995428224:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581317.526962:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c57f4789-35e1-4272-8645-acd484187c5c+5:2372:x1875462995428224:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 80us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581317.526970:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:2.0:1788581317.526988:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:2.0:1788581317.526994:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+5:2372:x1875462995428480:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:2.0:1788581317.527018:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+5:2372:x1875462995428480:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 25us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581317.527041:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00080000:0.0:1788581317.527225:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788581317.527229:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788581317.529543:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581317.529609:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581317.529647:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995428096 00000100:00100000:1.0:1788581317.529657:0:16415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995428096 00000100:00100000:1.0:1788581317.529705:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995428608 00000100:00100000:1.0:1788581317.529708:0:16415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995428608 00000100:00100000:1.0:1788581317.529725:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:1.0:1788581317.529745:0:16415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c57f4789-35e1-4272-8645-acd484187c5c+5:2372:x1875462995428096:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581317.529957:0:16415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c57f4789-35e1-4272-8645-acd484187c5c+5:2372:x1875462995428096:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 214us (3288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581317.529966:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:1.0:1788581317.529983:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:1.0:1788581317.529989:0:16415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b18916b8-1f25-41d8-9a9b-e15210a2edd6+5:2372:x1875462995428608:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:1.0:1788581317.530011:0:16415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b18916b8-1f25-41d8-9a9b-e15210a2edd6+5:2372:x1875462995428608:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 23us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581317.530018:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00080000:0.0:1788581317.530100:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788581317.530104:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581317.530150:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995428352 00000100:00100000:0.0:1788581317.530154:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995428352 00000100:00100000:0.0:1788581317.530200:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00100000:0.0:1788581317.530228:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:2372:x1875462995428352:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:0.0:1788581317.530288:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:2372:x1875462995428352:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 71us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581317.530295:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00080000:1.0:1788581317.531108:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788581317.620094:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581318.256353:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581318.256382:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014298240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788581318.256454:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581318.257915:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014298240 00000100:00100000:3.0:1788581318.257929:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014298240 00000100:00100000:3.0:1788581318.257993:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788581318.258015:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014298240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788581318.258058:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788581318.258148:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014298240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581318.258169:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788581318.258326:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014298240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581318.276670:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581318.277491:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995428736 00000100:00100000:3.0:1788581318.277506:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995428736 00000100:00100000:3.0:1788581318.277585:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:3.0:1788581318.277596:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+6:14437:x1875462995428736:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581318.277625:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581318.277658:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a71429 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d94a9 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.277762:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71430 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.277781:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71430 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.277802:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71430 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.277818:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a71437 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.277825:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a71437 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.277832:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a71437 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.279782:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe800/0xf54e3944c2a7143e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.279829:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe800/0xf54e3944c2a7143e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.279842:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe800/0xf54e3944c2a7143e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581318.279888:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788581318.279893:0:14418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581318.279946:0:14418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe800/0xf54e3944c2a7143e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.279962:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71430 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.279970:0:14418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71430 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.282017:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71430 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.282026:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821cf400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581318.282032:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71430 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.282165:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71430 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.282192:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91904995aa00) 00010000:00010000:3.0:1788581318.282195:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581318.282202:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71430 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.282236:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71430 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.282285:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a71437 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.282293:0:14418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a71437 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.282299:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a71437 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.282303:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581318.282306:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a71437 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.282312:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a71437 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.282320:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff919043bfea00) 00010000:00010000:3.0:1788581318.282323:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581318.282326:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a71437 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.282332:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a71437 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.284358:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a71429 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94a9 expref: 8 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.284449:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe800/0xf54e3944c2a7143e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94a9 expref: 7 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.284460:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff919043bfee00) 00010000:00010000:3.0:1788581318.284463:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581318.284467:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413fe800, rc 0) 00000100:00100000:3.0:1788581318.284564:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+7:14437:x1875462995428736:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 6968us (7908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581318.284576:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:0.0:1788581318.295661:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581318.295783:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995428992 00000100:00100000:3.0:1788581318.295799:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995428992 00000100:00100000:3.0:1788581318.295879:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:3.0:1788581318.295891:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+7:14437:x1875462995428992:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581318.295920:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581318.295949:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a71445 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d94b0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.296047:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a7144c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.296063:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a7144c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.296076:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a7144c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.296092:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a71453 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.296118:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a71453 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.296138:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a71453 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.296658:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a7145a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.296671:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a7145a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.296679:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a7145a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581318.296691:0:14416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788581318.296982:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a7144c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.296991:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a7144c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.297000:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a7144c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.297007:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413fec00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581318.297012:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a7144c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.297022:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a7144c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.297050:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff919043bfee00) 00010000:00010000:3.0:1788581318.297053:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581318.297059:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a7144c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.297066:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a7144c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.297087:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a71453 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.297095:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a71453 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.297101:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a71453 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.297107:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413ff200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581318.297110:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a71453 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.297117:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a71453 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.297125:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff919043bfe600) 00010000:00010000:3.0:1788581318.297127:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581318.297131:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a71453 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.297137:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a71453 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.297881:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a71445 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94b0 expref: 10 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.297905:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff000/0xf54e3944c2a7145a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94b0 expref: 9 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.297915:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919043bfed00) 00010000:00010000:3.0:1788581318.297917:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581318.297920:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413ff000, rc 0) 00000100:00100000:3.0:1788581318.298028:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+9:14437:x1875462995428992:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 2136us (2381us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788581318.298039:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:0.0:1788581318.301305:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581318.301661:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995429120 00000100:00100000:3.0:1788581318.301675:0:16416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995429120 00000100:00100000:3.0:1788581318.301762:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:3.0:1788581318.301776:0:16416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+9:14437:x1875462995429120:12345-192.168.201.13@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788581318.301939:0:16416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+9:14437:x1875462995429120:12345-192.168.201.13@tcp:59:lhsmtool_posix.0 Request processed in 165us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581318.301947:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:1.0:1788581318.336092:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581318.336308:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995429248 00000100:00100000:3.0:1788581318.336336:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995429248 00000100:00100000:3.0:1788581318.336435:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:3.0:1788581318.336452:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+9:14443:x1875462995429248:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581318.336496:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581318.336535:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a71468 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d94b7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.336661:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7146f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.336679:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7146f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.336696:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7146f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.336735:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71476 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.336743:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71476 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.336750:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71476 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.337379:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7146f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.337396:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7146f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.337456:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7146f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.337462:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413ff200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581318.337468:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7146f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.337487:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7146f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.337503:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91904995aa00) 00010000:00010000:3.0:1788581318.337506:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581318.337513:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7146f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.337519:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a7146f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.337537:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71476 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.337543:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71476 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.337609:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71476 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.337617:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413fec00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581318.337620:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71476 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.337626:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71476 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.337635:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff919043bfe600) 00010000:00010000:3.0:1788581318.337637:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581318.337640:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71476 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.337657:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71476 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.337705:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a71468 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94b7 expref: 10 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.337792:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91904995aa00) 00010000:00010000:3.0:1788581318.337794:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581318.337799:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a71468 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94b7 expref: 10 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.337810:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413fe200, rc 0) 00000100:00100000:3.0:1788581318.338075:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+9:14443:x1875462995429248:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1623us (2002us total) trans 0 rc 301/301 00000100:00100000:3.0:1788581318.338090:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:0.0:1788581318.343790:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581318.343922:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995429376 00000100:00100000:3.0:1788581318.343936:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995429376 00000100:00100000:3.0:1788581318.344014:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:3.0:1788581318.344027:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c57f4789-35e1-4272-8645-acd484187c5c+9:14443:x1875462995429376:12345-192.168.201.13@tcp:700:lfs.0 00000100:00100000:3.0:1788581318.344181:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c57f4789-35e1-4272-8645-acd484187c5c+9:14443:x1875462995429376:12345-192.168.201.13@tcp:700:lfs.0 Request processed in 155us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581318.344189:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:1.0:1788581318.347457:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581318.347610:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995429632 00000100:00100000:3.0:1788581318.347624:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995429632 00000100:00100000:3.0:1788581318.347705:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:3.0:1788581318.347728:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+9:14443:x1875462995429632:12345-192.168.201.13@tcp:36:lfs.0 00010000:00010000:3.0:1788581318.347845:0:14418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581318.347884:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7dc00/0xf54e3944c2a713ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9432 expref: 9 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.347909:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91904995aa00) 00010000:00010000:3.0:1788581318.347915:0:14418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581318.348213:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7147d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.348231:0:14418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a713e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9494 expref: 5 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.348411:0:14418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7147d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.348452:0:14418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a713e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9494 expref: 5 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.348467:0:14418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a713e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9494 expref: 5 pid: 14416 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581318.348484:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91906c7e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14418:1875463014298368:192.168.201.13@tcp:104: 00000100:00100000:3.0:1788581318.349577:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff919044f829c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581318.352527:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91906c7e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14418:1875463014298368:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581318.352574:0:14418:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7147d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581318.353977:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581318.354059:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995429760 00000100:00100000:2.0:1788581318.354072:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995429760 00010000:00010000:2.0:1788581318.354136:0:14402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a713e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9494 expref: 6 pid: 14416 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581318.354179:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:2.0:1788581318.354191:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:2374:x1875462995429760:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581318.354209:0:14402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581318.354216:0:14402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a713e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9494 expref: 6 pid: 14416 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.354230:0:14402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a713e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9494 expref: 6 pid: 14416 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.354274:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a713e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9494 expref: 6 pid: 14416 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.354292:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91904995aa00) 00010000:00010000:2.0:1788581318.354298:0:14402:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7147d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.354309:0:14402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7147d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.354317:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7147d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.354364:0:14402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581318.354402:0:14418:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7147d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.354424:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7147d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581318.354433:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b18916b8-1f25-41d8-9a9b-e15210a2edd6+5:2374:x1875462995429760:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 238us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581318.354441:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00010000:00010000:3.0:1788581318.354457:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71484 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.354470:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71484 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.354480:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71484 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581318.358109:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788581318.358206:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7147d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.358219:0:14418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7147d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.358228:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7147d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.358234:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413fe200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581318.358240:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7147d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.358281:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7147d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.358306:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91904995aa00) 00010000:00010000:3.0:1788581318.358310:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581318.358327:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7147d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.358335:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7147d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581318.358368:0:14418:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fcf9440 reply state 000000006fb7e0fa transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71484 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581318.358380:0:14418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788581318.358594:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+10:14443:x1875462995429632:12345-192.168.201.13@tcp:36:lfs.0 Request processed in 10872us (11145us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788581318.358606:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 19 00010000:00010000:2.0:1788581318.371099:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71484 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.371126:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71484 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.371142:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71484 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.371149:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413fec00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581318.371155:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71484 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.371164:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71484 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.371190:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff919043bfe600) 00010000:00010000:2.0:1788581318.371194:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581318.371200:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71484 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.371207:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71484 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581318.436668:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581318.436833:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995429888 00000100:00100000:3.0:1788581318.436848:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995429888 00000100:00100000:3.0:1788581318.436931:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:3.0:1788581318.436943:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+9:14451:x1875462995429888:12345-192.168.201.13@tcp:101:lctl.0 00010000:00010000:3.0:1788581318.436977:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581318.437008:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7148b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d94be expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.437095:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a71492 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.437112:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a71492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.437125:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a71492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581318.437187:0:14416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788581318.437210:0:14416:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581318.437297:0:14416:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a71492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.437323:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7148b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94be expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.437342:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ff200/0xf54e3944c2a71492 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94be expref: 10 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.437349:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919043bfea00) 00010000:00010000:3.0:1788581318.437351:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788581318.437354:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413ff200, rc 0) 00000100:00100000:3.0:1788581318.437998:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+10:14451:x1875462995429888:12345-192.168.201.13@tcp:101:lctl.0 Request processed in 489us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581318.438010:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:1.0:1788581318.459913:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581318.460033:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995430016 00000100:00100000:0.0:1788581318.460048:0:16416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995430016 00000100:00100000:0.0:1788581318.460135:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:0.0:1788581318.460149:0:16416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b18916b8-1f25-41d8-9a9b-e15210a2edd6+5:14452:x1875462995430016:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1788581318.460178:0:16416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581318.460205:0:16416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7cc00/0xf54e3944c2a71499 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d94c5 expref: -99 pid: 16416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.460331:0:16416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c400/0xf54e3944c2a714a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.460347:0:16416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c400/0xf54e3944c2a714a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.460360:0:16416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c400/0xf54e3944c2a714a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581318.460613:0:16416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788581318.460619:0:16416:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788581318.460650:0:16416:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c400/0xf54e3944c2a714a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.460681:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7cc00/0xf54e3944c2a71499 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94c5 expref: 7 pid: 16416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.460704:0:16416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c400/0xf54e3944c2a714a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94c5 expref: 6 pid: 16416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.460724:0:16416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919043bfea00) 00010000:00010000:0.0:1788581318.460728:0:16416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581318.460732:0:16416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919075b7c400, rc 0) 00000100:00100000:0.0:1788581318.460809:0:16416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:14452:x1875462995430016:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 663us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581318.460818:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 21 00000100:00100000:1.0:1788581318.464147:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581318.464273:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995430144 00000100:00100000:0.0:1788581318.464286:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995430144 00000100:00100000:0.0:1788581318.464363:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:0.0:1788581318.464376:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:14452:x1875462995430144:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1788581318.464403:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581318.464442:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ca00/0xf54e3944c2a714a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d94cc expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464531:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a714ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464571:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a714ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464586:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a714ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464607:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7dc00/0xf54e3944c2a714b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464615:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7dc00/0xf54e3944c2a714b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464622:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7dc00/0xf54e3944c2a714b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464754:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d600/0xf54e3944c2a714bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464763:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d600/0xf54e3944c2a714bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464771:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d600/0xf54e3944c2a714bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581318.464811:0:14417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788581318.464816:0:14417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788581318.464838:0:14417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d600/0xf54e3944c2a714bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464852:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a714ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464870:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a714ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464878:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a714ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464884:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919075b7d400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581318.464889:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a714ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464898:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a714ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464913:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919043bfea00) 00010000:00010000:0.0:1788581318.464917:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581318.464922:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a714ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464928:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a714ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464944:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7dc00/0xf54e3944c2a714b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464951:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7dc00/0xf54e3944c2a714b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464957:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7dc00/0xf54e3944c2a714b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464963:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919075b7dc00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581318.464972:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7dc00/0xf54e3944c2a714b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464980:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7dc00/0xf54e3944c2a714b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.464988:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91904995a500) 00010000:00010000:0.0:1788581318.464991:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581318.464995:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7dc00/0xf54e3944c2a714b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.465001:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7dc00/0xf54e3944c2a714b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.465035:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ca00/0xf54e3944c2a714a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94cc expref: 8 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.465050:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d600/0xf54e3944c2a714bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94cc expref: 7 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.465058:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91904995a000) 00010000:00010000:0.0:1788581318.465061:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581318.465063:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919075b7d600, rc 0) 00000100:00100000:0.0:1788581318.465150:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+7:14452:x1875462995430144:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 776us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581318.465157:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 22 00000100:00100000:1.0:1788581318.470375:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581318.470496:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995430400 00000100:00100000:0.0:1788581318.470509:0:16416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995430400 00000100:00100000:0.0:1788581318.470588:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00100000:0.0:1788581318.470600:0:16416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b18916b8-1f25-41d8-9a9b-e15210a2edd6+7:14452:x1875462995430400:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1788581318.470645:0:16416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581318.470674:0:16416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7cc00/0xf54e3944c2a714c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d94d3 expref: -99 pid: 16416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581318.470827:0:16416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788581318.470993:0:16416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7cc00/0xf54e3944c2a714c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94d3 expref: 9 pid: 16416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.471012:0:16416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919043bfea00) 00010000:00010000:0.0:1788581318.471015:0:16416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581318.471022:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7cc00/0xf54e3944c2a714c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94d3 expref: 9 pid: 16416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.471039:0:16416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919075b7cc00, rc 0) 00000100:00100000:0.0:1788581318.471116:0:16416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b18916b8-1f25-41d8-9a9b-e15210a2edd6+8:14452:x1875462995430400:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 517us (756us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788581318.472420:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 23 00000100:00100000:1.0:1788581318.475591:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581318.475675:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995430656 00000100:00100000:0.0:1788581318.475688:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995430656 00000100:00100000:0.0:1788581318.475774:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 24 00000100:00100000:0.0:1788581318.475786:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+8:14452:x1875462995430656:12345-192.168.201.13@tcp:36:lfs.0 00010000:00010000:0.0:1788581318.475863:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581318.475903:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d600/0xf54e3944c2a714bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94cc expref: 8 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.475926:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91904995a000) 00010000:00010000:0.0:1788581318.475940:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581318.475995:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ca00/0xf54e3944c2a714d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.476011:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ca00/0xf54e3944c2a714d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.476023:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ca00/0xf54e3944c2a714d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788581318.476370:0:14417:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8b195e7 reply state 0000000042232822 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ca00/0xf54e3944c2a714d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581318.476383:0:14417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788581318.476394:0:14417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788581318.476497:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+9:14452:x1875462995430656:12345-192.168.201.13@tcp:36:lfs.0 Request processed in 712us (918us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788581318.476505:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 24 00010000:00010000:2.0:1788581318.479138:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ca00/0xf54e3944c2a714d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.479187:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ca00/0xf54e3944c2a714d1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.479196:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ca00/0xf54e3944c2a714d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.479202:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919075b7ca00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581318.479208:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ca00/0xf54e3944c2a714d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.479216:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ca00/0xf54e3944c2a714d1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.479237:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91904995a500) 00010000:00010000:2.0:1788581318.479240:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788581318.479287:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ca00/0xf54e3944c2a714d1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.479293:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ca00/0xf54e3944c2a714d1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581318.480281:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581318.480420:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995430912 00000100:00100000:2.0:1788581318.480446:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995430912 00000100:00100000:2.0:1788581318.480513:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:2.0:1788581318.480526:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b18916b8-1f25-41d8-9a9b-e15210a2edd6+8:14452:x1875462995430912:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:2.0:1788581318.480963:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b18916b8-1f25-41d8-9a9b-e15210a2edd6+9:14452:x1875462995430912:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 438us (720us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788581318.480973:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:1.0:1788581318.484678:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581318.484840:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995431168 00000100:00100000:3.0:1788581318.484854:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995431168 00000100:00100000:3.0:1788581318.484957:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 25 00000100:00100000:3.0:1788581318.484969:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b18916b8-1f25-41d8-9a9b-e15210a2edd6+9:14452:x1875462995431168:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581318.485002:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581318.485029:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a714d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d94da expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485136:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a714df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485152:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a714df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485187:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a714df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485204:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a714e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485212:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a714e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485219:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a714e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581318.485384:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788581318.485513:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a714df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485521:0:14418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a714df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485528:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a714df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485535:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413ffc00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581318.485539:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a714df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485547:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a714df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485561:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919043bfea00) 00010000:00010000:3.0:1788581318.485564:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581318.485575:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a714df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485582:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a714df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485600:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a714e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485607:0:14418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a714e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485613:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a714e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485618:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413fec00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581318.485621:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a714e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485626:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a714e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485633:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff919043bfe100) 00010000:00010000:3.0:1788581318.485635:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581318.485637:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a714e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485643:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a714e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485684:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a714d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94da expref: 11 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485704:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919043bfea00) 00010000:00010000:3.0:1788581318.485706:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788581318.485710:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a714d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94da expref: 11 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.485739:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413fe200, rc 0) 00000100:00100000:3.0:1788581318.485813:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b18916b8-1f25-41d8-9a9b-e15210a2edd6+10:14452:x1875462995431168:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 847us (1149us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788581318.485822:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 25 00000100:00100000:0.0:1788581318.489074:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581318.489223:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995431296 00000100:00100000:2.0:1788581318.490521:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995431296 00000100:00100000:2.0:1788581318.490677:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 26 00000100:00100000:2.0:1788581318.490691:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+10:14452:x1875462995431296:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:2.0:1788581318.490740:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581318.490774:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a714f4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d94e1 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.490921:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a714fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.490939:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a714fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.490954:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a714fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788581318.490991:0:14417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788581318.490995:0:14417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788581318.491018:0:14417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a714fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.491053:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a714f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94e1 expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.491077:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a714fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94e1 expref: 11 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.491087:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91905c525700) 00010000:00010000:2.0:1788581318.491090:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788581318.491095:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91906cb63400, rc 0) 00000100:00100000:2.0:1788581318.491392:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+11:14452:x1875462995431296:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 702us (2328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581318.491401:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 26 00000100:00100000:1.0:1788581318.496109:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581318.496236:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995431424 00000100:00100000:0.0:1788581318.496286:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995431424 00000100:00100000:0.0:1788581318.496357:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:0.0:1788581318.496370:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+11:14452:x1875462995431424:12345-192.168.201.13@tcp:37:lfs.0 00000100:00100000:1.0:1788581318.504411:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+11:14452:x1875462995431424:12345-192.168.201.13@tcp:37:lfs.0 Request processed in 8024us (8298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581318.504431:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:1.0:1788581318.507980:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581318.508130:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995431680 00000100:00100000:2.0:1788581318.508142:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995431680 00000100:00100000:2.0:1788581318.508239:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:2.0:1788581318.508305:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919042adb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b18916b8-1f25-41d8-9a9b-e15210a2edd6+11:14452:x1875462995431680:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:2.0:1788581318.508579:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919042adb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b18916b8-1f25-41d8-9a9b-e15210a2edd6+12:14452:x1875462995431680:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 276us (611us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788581318.508587:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:2.0:1788581318.578031:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581318.578202:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995431808 00000100:00100000:0.0:1788581318.578216:0:16416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995431808 00000100:00100000:0.0:1788581318.578338:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:0.0:1788581318.578349:0:16416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+10:14459:x1875462995431808:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:0.0:1788581318.578378:0:16416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581318.578407:0:16416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a71502 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d94e8 expref: -99 pid: 16416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.578531:0:16416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c800/0xf54e3944c2a71509 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.578551:0:16416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c800/0xf54e3944c2a71509 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.578565:0:16416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c800/0xf54e3944c2a71509 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.578584:0:16416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d000/0xf54e3944c2a71510 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.578591:0:16416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d000/0xf54e3944c2a71510 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.578598:0:16416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d000/0xf54e3944c2a71510 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.578840:0:16416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d200/0xf54e3944c2a71517 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.578848:0:16416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d200/0xf54e3944c2a71517 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.578854:0:16416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d200/0xf54e3944c2a71517 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581318.578887:0:16416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788581318.578891:0:16416:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788581318.578929:0:16416:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d200/0xf54e3944c2a71517 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.578951:0:16416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c800/0xf54e3944c2a71509 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.578956:0:16416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c800/0xf54e3944c2a71509 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.578961:0:16416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c800/0xf54e3944c2a71509 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.578965:0:16416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919075b7c800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581318.578969:0:16416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c800/0xf54e3944c2a71509 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.578975:0:16416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c800/0xf54e3944c2a71509 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.578986:0:16416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919043bfea00) 00010000:00010000:0.0:1788581318.578988:0:16416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581318.578992:0:16416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c800/0xf54e3944c2a71509 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.578995:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c800/0xf54e3944c2a71509 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.579007:0:16416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d000/0xf54e3944c2a71510 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.579011:0:16416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d000/0xf54e3944c2a71510 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.579015:0:16416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d000/0xf54e3944c2a71510 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.579023:0:16416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919075b7d000 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581318.579025:0:16416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d000/0xf54e3944c2a71510 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.579029:0:16416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d000/0xf54e3944c2a71510 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.579091:0:16416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91904995a000) 00010000:00010000:0.0:1788581318.579094:0:16416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581318.579096:0:16416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d000/0xf54e3944c2a71510 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.579100:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d000/0xf54e3944c2a71510 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.579134:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a71502 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94e8 expref: 12 pid: 16416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.579148:0:16416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d200/0xf54e3944c2a71517 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94e8 expref: 11 pid: 16416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.579155:0:16416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91905c525700) 00010000:00010000:0.0:1788581318.579158:0:16416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788581318.579161:0:16416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919075b7d200, rc 0) 00000100:00100000:0.0:1788581318.582262:0:16416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+11:14459:x1875462995431808:12345-192.168.201.13@tcp:101:bash.0 Request processed in 3875us (4202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581318.582277:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:3.0:1788581318.584225:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581318.584405:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995432064 00000100:00100000:1.0:1788581318.584420:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995432064 00000100:00100000:1.0:1788581318.584502:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 28 00000100:00100000:1.0:1788581318.584514:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+11:14459:x1875462995432064:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:1.0:1788581318.584543:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581318.584574:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7151e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d94ef expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581318.585461:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a71525 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581318.585488:0:14416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a714fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94e1 expref: 11 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581318.585524:0:14416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a71525 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581318.585575:0:14416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a714fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94e1 expref: 11 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581318.585592:0:14416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a714fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94e1 expref: 11 pid: 14417 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581318.585610:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14416:1875463014298496:192.168.201.13@tcp:104: 00000100:00100000:1.0:1788581318.590306:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff91905083d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581318.591780:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581318.591878:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995432192 00000100:00100000:0.0:1788581318.591910:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995432192 00010000:00010000:0.0:1788581318.591968:0:14403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a714fb lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94e1 expref: 12 pid: 14417 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581318.592026:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:0.0:1788581318.592048:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+12:2374:x1875462995432192:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581318.592070:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581318.592077:0:14403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a714fb lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94e1 expref: 12 pid: 14417 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.592093:0:14403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a714fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94e1 expref: 12 pid: 14417 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.592122:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91905c525700) 00010000:00010000:0.0:1788581318.592128:0:14403:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a71525 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.592140:0:14403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a71525 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.592149:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a71525 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.592173:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581318.592271:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b18916b8-1f25-41d8-9a9b-e15210a2edd6+12:2374:x1875462995432192:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 234us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581318.592279:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00010000:00010000:3.0:1788581318.597647:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a714fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94e1 expref: 11 pid: 14417 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581318.597683:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14416:1875463014298496:192.168.201.13@tcp:104: 00010000:00010000:3.0:1788581318.597741:0:14416:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a71525 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.597754:0:14416:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a71525 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.597760:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a71525 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.597801:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7152c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.597816:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7152c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.597856:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7152c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.598837:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71533 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.598853:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71533 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.598863:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71533 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581318.598878:0:14416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788581318.598916:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a71525 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.598924:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a71525 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.598932:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a71525 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.598939:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581318.598944:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a71525 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.598952:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a71525 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.598969:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91905c525700) 00010000:00010000:3.0:1788581318.598973:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581318.598988:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a71525 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.598995:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a71525 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788581318.599010:0:14416:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006376ef0 reply state 00000000cc7c61e6 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7152c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581318.599020:0:14416:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788581318.599067:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9400/0xf54e3944c2a7151e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94ef expref: 14 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.599084:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71533 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94ef expref: 13 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.599093:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:3.0:1788581318.599096:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788581318.599098:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413fec00, rc 0) 00000100:00100000:3.0:1788581318.599209:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+14:14459:x1875462995432064:12345-192.168.201.13@tcp:101:bash.0 Request processed in 14695us (14992us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788581318.599220:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 28 00010000:00010000:2.0:1788581318.612312:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7152c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.612335:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7152c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.612344:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7152c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.612351:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413fe200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581318.612890:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7152c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.612904:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7152c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.612929:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff919043bfe100) 00010000:00010000:2.0:1788581318.612932:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581318.612965:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7152c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.612972:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fe200/0xf54e3944c2a7152c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581318.613748:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581318.613802:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995432320 00000100:00100000:3.0:1788581318.613817:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995432320 00000100:00100000:3.0:1788581318.613897:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 29 00000100:00100000:3.0:1788581318.613911:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+13:14459:x1875462995432320:12345-192.168.201.13@tcp:101:bash.0 00010000:00010000:3.0:1788581318.613944:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581318.613967:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a71541 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d94f6 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.614081:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a71548 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.614097:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a71548 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.614109:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a71548 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581318.614173:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788581318.614178:0:14418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788581318.614201:0:14418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a71548 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.614212:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a71548 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.614263:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413ffc00/0xf54e3944c2a71541 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94f6 expref: 15 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.614285:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a71548 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94f6 expref: 14 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.614293:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:3.0:1788581318.614296:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581318.614299:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce000, rc 0) 00000100:00100000:3.0:1788581318.614379:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+14:14459:x1875462995432320:12345-192.168.201.13@tcp:101:bash.0 Request processed in 471us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581318.614386:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 29 00000100:00100000:1.0:1788581318.619145:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581318.619335:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995432576 00000100:00100000:2.0:1788581318.619350:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995432576 00000100:00100000:2.0:1788581318.619616:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:2.0:1788581318.619634:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c57f4789-35e1-4272-8645-acd484187c5c+14:14459:x1875462995432576:12345-192.168.201.13@tcp:35:bash.0 00000100:00100000:2.0:1788581318.626590:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c57f4789-35e1-4272-8645-acd484187c5c+15:14459:x1875462995432576:12345-192.168.201.13@tcp:35:bash.0 Request processed in 6942us (7451us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788581318.626610:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 5 00010000:00010000:3.0:1788581318.639590:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581318.740146:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581318.740634:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995432832 00000100:00100000:0.0:1788581318.740649:0:16416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995432832 00000100:00100000:0.0:1788581318.740804:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 30 00000100:00100000:0.0:1788581318.740817:0:16416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+15:14469:x1875462995432832:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:0.0:1788581318.740855:0:16416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581318.740884:0:16416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a7154f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d94fd expref: -99 pid: 16416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581318.741012:0:16416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788581318.741170:0:16416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a7154f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94fd expref: 17 pid: 16416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.741189:0:16416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919043bfea00) 00010000:00010000:0.0:1788581318.741192:0:16416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788581318.741197:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a7154f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94fd expref: 17 pid: 16416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581318.741213:0:16416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919075b7d400, rc 0) 00000100:00100000:0.0:1788581318.741366:0:16416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+16:14469:x1875462995432832:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 542us (1226us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788581318.741373:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 30 00000100:00100000:3.0:1788581318.746295:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581318.746976:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995433088 00000100:00100000:1.0:1788581318.746991:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995433088 00000100:00100000:1.0:1788581318.747113:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:1.0:1788581318.747134:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906c7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c57f4789-35e1-4272-8645-acd484187c5c+16:14469:x1875462995433088:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:1.0:1788581318.747547:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906c7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c57f4789-35e1-4272-8645-acd484187c5c+17:14469:x1875462995433088:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 421us (1266us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788581318.747557:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:1.0:1788581318.804594:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581318.804767:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995433344 00000100:00100000:3.0:1788581318.804781:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995433344 00000100:00100000:3.0:1788581318.804924:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 31 00000100:00100000:3.0:1788581318.804938:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+17:14472:x1875462995433344:12345-192.168.201.13@tcp:101:lfs.0 00010000:00010000:3.0:1788581318.804978:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581318.805011:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a7155d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9504 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.805175:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71564 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.805195:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71564 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.805211:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71564 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581318.805509:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788581318.805777:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a7155d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9504 expref: 20 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.805803:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71564 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9504 expref: 19 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581318.805812:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:3.0:1788581318.805815:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581318.805820:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf400, rc 0) 00000100:00100000:3.0:1788581318.806549:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+19:14472:x1875462995433344:12345-192.168.201.13@tcp:101:lfs.0 Request processed in 1599us (1965us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788581318.807329:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 31 00000100:00100000:3.0:1788581318.811109:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581318.811192:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581318.811403:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995433472 00000100:00100000:1.0:1788581318.811418:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995433472 00000100:00100000:1.0:1788581318.811488:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 32 00000100:00100000:1.0:1788581318.811501:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+19:14472:x1875462995433472:12345-192.168.201.13@tcp:54:lfs.0 00010000:00010000:1.0:1788581318.811829:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8a00/0xf54e3944c2a71572 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581318.811852:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8a00/0xf54e3944c2a71572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581318.811866:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8a00/0xf54e3944c2a71572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581318.811902:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8a00/0xf54e3944c2a71572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581318.811909:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8a00/0xf54e3944c2a71572 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581318.811916:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8a00/0xf54e3944c2a71572 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581318.811923:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8a00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581318.811928:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8a00/0xf54e3944c2a71572 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581318.811936:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8a00/0xf54e3944c2a71572 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581318.811949:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:1.0:1788581318.811953:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581318.811958:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8a00/0xf54e3944c2a71572 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581318.811964:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8a00/0xf54e3944c2a71572 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581318.812079:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+19:14472:x1875462995433472:12345-192.168.201.13@tcp:54:lfs.0 Request processed in 579us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581318.812088:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 32 00000100:00100000:2.0:1788581318.812598:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995433600 00000100:00100000:2.0:1788581318.812606:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995433600 00000100:00100000:2.0:1788581318.812670:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:2.0:1788581318.812680:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c57f4789-35e1-4272-8645-acd484187c5c+19:2374:x1875462995433600:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581318.812694:0:14402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581318.812733:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71564 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9504 expref: 19 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581318.812752:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:2.0:1788581318.812756:0:14402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581318.812798:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c57f4789-35e1-4272-8645-acd484187c5c+18:2374:x1875462995433600:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 120us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581318.812806:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:3.0:1788581318.818045:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581318.827043:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995433856 00000100:00100000:2.0:1788581318.827102:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995433856 00000100:00100000:2.0:1788581318.827218:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:2.0:1788581318.827233:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c57f4789-35e1-4272-8645-acd484187c5c+18:14472:x1875462995433856:12345-192.168.201.13@tcp:35:lfs.0 00000100:00100000:2.0:1788581318.828041:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c57f4789-35e1-4272-8645-acd484187c5c+19:14472:x1875462995433856:12345-192.168.201.13@tcp:35:lfs.0 Request processed in 806us (10006us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788581318.828052:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:2.0:1788581319.069147:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581319.069277:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995434112 00000100:00100000:3.0:1788581319.069291:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995434112 00000100:00080000:1.0:1788581319.069460:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581319.069631:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:3.0:1788581319.069646:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c57f4789-35e1-4272-8645-acd484187c5c+19:14503:x1875462995434112:12345-192.168.201.13@tcp:101:cat.0 00010000:00010000:3.0:1788581319.069682:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581319.069720:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a71579 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d950b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581319.069908:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71580 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581319.069926:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71580 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581319.069939:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71580 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581319.069953:0:14417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788581319.070162:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a71579 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d950b expref: 22 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581319.070186:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71580 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d950b expref: 21 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581319.070211:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:3.0:1788581319.070214:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788581319.070217:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821cf400, rc 0) 00000100:00100000:3.0:1788581319.071974:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c57f4789-35e1-4272-8645-acd484187c5c+21:14503:x1875462995434112:12345-192.168.201.13@tcp:101:cat.0 Request processed in 2313us (2833us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788581319.071992:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 33 00000100:00100000:1.0:1788581319.074951:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581319.075050:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995434368 00000100:00100000:3.0:1788581319.075065:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995434368 00000100:00100000:2.0:1788581319.076051:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581319.076161:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:3.0:1788581319.076178:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c57f4789-35e1-4272-8645-acd484187c5c+21:14503:x1875462995434368:12345-192.168.201.13@tcp:35:cat.0 00000100:00100000:3.0:1788581319.076716:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c57f4789-35e1-4272-8645-acd484187c5c+22:14503:x1875462995434368:12345-192.168.201.13@tcp:35:cat.0 Request processed in 530us (1769us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788581319.077237:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 8 00000100:00100000:0.0:1788581319.077399:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995434496 00000100:00100000:0.0:1788581319.077411:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995434496 00000100:00100000:0.0:1788581319.077884:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:0.0:1788581319.077897:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43214000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c57f4789-35e1-4272-8645-acd484187c5c+22:2374:x1875462995434496:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581319.077914:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581319.077947:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a71580 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d950b expref: 22 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581319.077993:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:0.0:1788581319.077999:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581319.078056:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43214000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c57f4789-35e1-4272-8645-acd484187c5c+21:2374:x1875462995434496:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 163us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581319.078063:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 1 00000040:00080000:3.0:1788581319.102297:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788581319.132839:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581319.134810:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995434752 00000100:00100000:1.0:1788581319.134835:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995434752 00000100:00100000:1.0:1788581319.134997:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00100000:1.0:1788581319.135011:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+21:14509:x1875462995434752:12345-192.168.201.13@tcp:101:dd.0 00010000:00010000:1.0:1788581319.135048:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581319.135088:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8a00/0xf54e3944c2a7158e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9512 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581319.135278:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a71595 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581319.135297:0:14416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71533 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94ef expref: 22 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581319.135307:0:14416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a71548 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94f6 expref: 22 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581319.135317:0:14416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a71595 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581319.135376:0:14416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a71548 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94f6 expref: 22 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581319.135419:0:14416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a71548 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94f6 expref: 22 pid: 14418 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581319.135512:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14416:1875463014298624:192.168.201.13@tcp:104: 00010000:00010000:1.0:1788581319.135918:0:14416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71533 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94ef expref: 22 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581319.135930:0:14416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71533 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94ef expref: 22 pid: 14416 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581319.135940:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14416:1875463014298752:192.168.201.13@tcp:104: 00000100:00100000:1.0:1788581319.135972:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f426c9540 going to sleep for 11 seconds 00000100:00100000:1.0:1788581319.139957:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14416:1875463014298624:192.168.201.13@tcp:104: 00000100:00100000:1.0:1788581319.139977:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14416:1875463014298752:192.168.201.13@tcp:104: 00010000:00010000:1.0:1788581319.140012:0:14416:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a71595 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581319.140931:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581319.141025:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581319.142375:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995434880 00000100:00100000:3.0:1788581319.142393:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995434880 00000100:00100000:0.0:1788581319.142651:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995435008 00000100:00100000:0.0:1788581319.142656:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995435008 00010000:00010000:0.0:1788581319.142796:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71533 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94ef expref: 24 pid: 14416 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581319.142893:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:0.0:1788581319.142907:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43216d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c57f4789-35e1-4272-8645-acd484187c5c+24:2374:x1875462995435008:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788581319.142928:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581319.142937:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71533 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94ef expref: 24 pid: 14416 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581319.142952:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71533 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94ef expref: 24 pid: 14416 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581319.142983:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413fec00/0xf54e3944c2a71533 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94ef expref: 24 pid: 14416 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581319.143008:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:0.0:1788581319.143015:0:14404:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a71595 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581319.143048:0:14404:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a71595 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581319.143056:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581319.143363:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43216d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c57f4789-35e1-4272-8645-acd484187c5c+23:2374:x1875462995435008:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 457us (2341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581319.143374:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00010000:00010000:1.0:1788581319.144402:0:14403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a71548 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94f6 expref: 22 pid: 14418 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581319.144862:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:2.0:1788581319.144883:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f41c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c57f4789-35e1-4272-8645-acd484187c5c+22:2374:x1875462995434880:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788581319.144900:0:14402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581319.144909:0:14402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a71548 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94f6 expref: 22 pid: 14418 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581319.144925:0:14402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a71548 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94f6 expref: 22 pid: 14418 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581319.144952:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a71548 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d94f6 expref: 22 pid: 14418 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581319.144972:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:2.0:1788581319.144976:0:14402:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a71595 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581319.145007:0:14402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a71595 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581319.145015:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a71595 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581319.145064:0:14402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788581319.145226:0:14416:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a71595 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581319.145237:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a71595 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788581319.145280:0:14416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788581319.145651:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8a00/0xf54e3944c2a7158e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9512 expref: 23 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581319.145672:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8000/0xf54e3944c2a71595 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9512 expref: 22 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581319.145690:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:3.0:1788581319.145693:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788581319.145696:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8000, rc 0) 00000100:00100000:3.0:1788581319.145914:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+22:14509:x1875462995434752:12345-192.168.201.13@tcp:101:dd.0 Request processed in 10904us (13089us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788581319.145923:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 34 00000100:00100000:2.0:1788581319.146032:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f41c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c57f4789-35e1-4272-8645-acd484187c5c+21:2374:x1875462995434880:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 1159us (5108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581319.146041:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:2.0:1788581319.150232:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581319.150607:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995435264 00000100:00100000:1.0:1788581319.150622:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995435264 00000100:00100000:1.0:1788581319.150756:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 35 00000100:00100000:1.0:1788581319.150772:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+21:14509:x1875462995435264:12345-192.168.201.13@tcp:36:dd.0 00010000:00010000:1.0:1788581319.151187:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9200/0xf54e3944c2a715a3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581319.151212:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9200/0xf54e3944c2a715a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581319.151227:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9200/0xf54e3944c2a715a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788581319.151329:0:14418:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788581319.151376:0:14418:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af449e4e reply state 00000000822153b9 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9200/0xf54e3944c2a715a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581319.151387:0:14418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788581319.151798:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+24:14509:x1875462995435264:12345-192.168.201.13@tcp:36:dd.0 Request processed in 1026us (1577us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788581319.151807:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 35 00000020:00080000:1.0:1788581319.151813:0:14418:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788581319.159936:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9200/0xf54e3944c2a715a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581319.159965:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9200/0xf54e3944c2a715a3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581319.159975:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9200/0xf54e3944c2a715a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581319.159983:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581319.159989:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9200/0xf54e3944c2a715a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581319.159999:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9200/0xf54e3944c2a715a3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581319.160024:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:2.0:1788581319.160028:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788581319.160034:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9200/0xf54e3944c2a715a3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581319.160062:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9200/0xf54e3944c2a715a3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581319.160339:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581319.160791:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995435392 00000100:00100000:0.0:1788581319.160805:0:16416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995435392 00000100:00100000:0.0:1788581319.160886:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00100000:0.0:1788581319.160905:0:16416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+23:14509:x1875462995435392:12345-192.168.201.13@tcp:101:dd.0 00010000:00010000:0.0:1788581319.160941:0:16416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581319.160968:0:16416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c600/0xf54e3944c2a715aa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9519 expref: -99 pid: 16416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581319.161053:0:16416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c600/0xf54e3944c2a715aa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9519 expref: 24 pid: 16416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581319.161070:0:16416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c600/0xf54e3944c2a715aa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9519 expref: 24 pid: 16416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581319.161107:0:16416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:0.0:1788581319.161110:0:16416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788581319.161113:0:16416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919075b7c600, rc 0) 00000100:00100000:0.0:1788581319.161194:0:16416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+24:14509:x1875462995435392:12345-192.168.201.13@tcp:101:dd.0 Request processed in 292us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581319.161200:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 36 00000100:00100000:0.0:1788581319.173398:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581319.173733:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995435648 00000100:00100000:1.0:1788581319.173749:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995435648 00000100:00100000:1.0:1788581319.173986:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:1.0:1788581319.174001:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c57f4789-35e1-4272-8645-acd484187c5c+24:14509:x1875462995435648:12345-192.168.201.13@tcp:103:dd.0 00010000:00010000:1.0:1788581319.174024:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581319.174059:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c600/0xf54e3944c2a715aa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9519 expref: 24 pid: 16416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581319.174094:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:1.0:1788581319.174101:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581319.174183:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c57f4789-35e1-4272-8645-acd484187c5c+23:14509:x1875462995435648:12345-192.168.201.13@tcp:103:dd.0 Request processed in 186us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581319.174210:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:2.0:1788581319.176041:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581319.176175:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995435776 00000100:00100000:3.0:1788581319.176187:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995435776 00000100:00100000:3.0:1788581319.176280:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:3.0:1788581319.176294:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c57f4789-35e1-4272-8645-acd484187c5c+23:14509:x1875462995435776:12345-192.168.201.13@tcp:58:dd.0 00010000:00010000:3.0:1788581319.176512:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a715b1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581319.176534:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a715b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581319.176621:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a715b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788581319.178033:0:14417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581319.178435:0:14417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788581319.178535:0:14417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788581319.178692:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c57f4789-35e1-4272-8645-acd484187c5c+23:14509:x1875462995435776:12345-192.168.201.13@tcp:58:dd.0 Request processed in 2392us (2657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581319.178714:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 37 00000100:00100000:0.0:1788581319.184794:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581319.184914:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995435904 00000100:00100000:3.0:1788581319.184950:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995435904 00000100:00100000:3.0:1788581319.185035:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 38 00000100:00100000:3.0:1788581319.185048:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+23:14509:x1875462995435904:12345-192.168.201.13@tcp:101:dd.0 00010000:00010000:3.0:1788581319.185079:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581319.185111:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a715b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9520 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581319.185198:0:14416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a715b1 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581319.185212:0:14416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a715b8 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9520 expref: 24 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581319.185236:0:14416:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a715b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581319.185290:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a715b8 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9520 expref: 24 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581319.185309:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:3.0:1788581319.185313:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788581319.185318:0:14416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a715b8 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9520 expref: 24 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581319.185327:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190821ce000, rc 0) 00000100:00100000:3.0:1788581319.185402:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+24:14509:x1875462995435904:12345-192.168.201.13@tcp:101:dd.0 Request processed in 356us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581319.185411:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 38 00010000:00010000:0.0:1788581319.663629:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788581320.113938:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788581320.113950:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788581320.113997:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788581320.114005:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788581320.115763:0:14451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43215880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14451:1875463014298880:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788581320.116189:0:14451:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05540 going to sleep for 11 seconds 00000100:00100000:0.0:1788581320.122619:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581320.123814:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995436032 00000100:00100000:3.0:1788581320.123833:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995436032 00000100:00100000:3.0:1788581320.123911:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:3.0:1788581320.123923:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c57f4789-35e1-4272-8645-acd484187c5c+25:14510:x1875462995436032:12345-192.168.201.13@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788581320.124048:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c57f4789-35e1-4272-8645-acd484187c5c+25:14510:x1875462995436032:12345-192.168.201.13@tcp:900:lhsmtool_posix.0 Request processed in 127us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581320.124057:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:2.0:1788581320.125743:0:14451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43215880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14451:1875463014298880:192.168.201.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788581320.131820:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581320.131948:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995436160 00000100:00100000:1.0:1788581320.131962:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995436160 00000100:00100000:1.0:1788581320.132049:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 39 00000100:00100000:1.0:1788581320.132062:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+24:14510:x1875462995436160:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788581320.132109:0:14418:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788581320.132311:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+24:14510:x1875462995436160:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 250us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581320.132319:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 39 00000100:00100000:3.0:1788581320.135856:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581320.136842:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995436288 00000100:00100000:0.0:1788581320.136861:0:16416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995436288 00000100:00100000:0.0:1788581320.137055:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 40 00000100:00100000:0.0:1788581320.137080:0:16416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+24:14510:x1875462995436288:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788581320.137198:0:16416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7da00/0xf54e3944c2a715bf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137220:0:16416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7da00/0xf54e3944c2a715bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137237:0:16416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7da00/0xf54e3944c2a715bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137464:0:16416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ce00/0xf54e3944c2a715c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137473:0:16416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ce00/0xf54e3944c2a715c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137481:0:16416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ce00/0xf54e3944c2a715c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137511:0:16416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c600/0xf54e3944c2a715cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137522:0:16416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c600/0xf54e3944c2a715cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137550:0:16416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c600/0xf54e3944c2a715cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581320.137603:0:16416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788581320.137608:0:16416:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788581320.137627:0:16416:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c600/0xf54e3944c2a715cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137641:0:16416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7da00/0xf54e3944c2a715bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137648:0:16416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7da00/0xf54e3944c2a715bf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137656:0:16416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7da00/0xf54e3944c2a715bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137662:0:16416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919075b7da00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581320.137668:0:16416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7da00/0xf54e3944c2a715bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137677:0:16416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7da00/0xf54e3944c2a715bf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137706:0:16416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919043bfed00) 00010000:00010000:0.0:1788581320.137710:0:16416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581320.137715:0:16416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7da00/0xf54e3944c2a715bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137722:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7da00/0xf54e3944c2a715bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137749:0:16416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ce00/0xf54e3944c2a715c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137755:0:16416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ce00/0xf54e3944c2a715c6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137762:0:16416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ce00/0xf54e3944c2a715c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137767:0:16416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919075b7ce00 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581320.137770:0:16416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ce00/0xf54e3944c2a715c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137777:0:16416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ce00/0xf54e3944c2a715c6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137785:0:16416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff91904995a000) 00010000:00010000:0.0:1788581320.137788:0:16416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581320.137791:0:16416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ce00/0xf54e3944c2a715c6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137796:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ce00/0xf54e3944c2a715c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137812:0:16416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c600/0xf54e3944c2a715cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137820:0:16416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c600/0xf54e3944c2a715cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137826:0:16416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c600/0xf54e3944c2a715cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137838:0:16416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919075b7c600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581320.137842:0:16416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c600/0xf54e3944c2a715cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137849:0:16416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c600/0xf54e3944c2a715cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137857:0:16416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:0.0:1788581320.137860:0:16416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581320.137863:0:16416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c600/0xf54e3944c2a715cd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.137870:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7c600/0xf54e3944c2a715cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581320.137991:0:16416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+24:14510:x1875462995436288:12345-192.168.201.13@tcp:34:lhsmtool_posix.0 Request processed in 922us (2149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581320.138001:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 40 00000100:00100000:0.0:1788581320.152860:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581320.152963:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995436544 00000100:00100000:1.0:1788581320.152979:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995436544 00000100:00100000:1.0:1788581320.153055:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:1.0:1788581320.153065:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+24:14510:x1875462995436544:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581320.153097:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581320.153137:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a715d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9527 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.153331:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.153605:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.153621:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581320.153638:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788581320.154929:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.154948:0:14418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715db lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.154956:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.154962:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581320.154966:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.154974:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.154995:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:1.0:1788581320.154998:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788581320.155004:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715db lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.155011:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.155088:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a715d4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9527 expref: 26 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.155101:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919043bfed00) 00010000:00010000:1.0:1788581320.155114:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788581320.155118:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a715d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9527 expref: 26 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.156727:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca8800, rc 0) 00000100:00100000:1.0:1788581320.157625:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+25:14510:x1875462995436544:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 4549us (4773us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788581320.157648:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 41 00000100:00100000:1.0:1788581320.166006:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581320.166791:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995436672 00000100:00100000:3.0:1788581320.166807:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995436672 00000100:00100000:3.0:1788581320.166896:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:3.0:1788581320.166910:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+25:14510:x1875462995436672:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788581320.166963:0:14416:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788581320.167119:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+25:14510:x1875462995436672:12345-192.168.201.13@tcp:53:lhsmtool_posix.0 Request processed in 211us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581320.167129:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 42 00000100:00100000:2.0:1788581320.177990:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581320.178143:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995436928 00000100:00100000:3.0:1788581320.178157:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995436928 00000100:00100000:3.0:1788581320.178235:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 43 00000100:00100000:3.0:1788581320.178282:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c57f4789-35e1-4272-8645-acd484187c5c+25:14510:x1875462995436928:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788581320.178312:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581320.178340:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a715e9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d952e expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788581320.187361:0:14417:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1788581320.187390:0:14417:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788581320.187474:0:14417:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788581320.188044:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a715f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.188066:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a715f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.188081:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a715f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.189547:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821cf400/0xf54e3944c2a715e9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d952e expref: 28 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.189589:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a715f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d952e expref: 27 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.189620:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91905c525400) 00010000:00010000:2.0:1788581320.189624:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788581320.189628:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91906cb63200, rc 0) 00000100:00100000:2.0:1788581320.191634:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c57f4789-35e1-4272-8645-acd484187c5c+27:14510:x1875462995436928:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 13372us (13642us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788581320.191663:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 43 00000100:00100000:3.0:1788581320.206120:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581320.206589:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995437184 00000100:00100000:1.0:1788581320.206603:0:16416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995437184 00000100:00100000:1.0:1788581320.206680:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:1.0:1788581320.206700:0:16416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+27:14510:x1875462995437184:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788581320.206793:0:16416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581320.206832:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a715f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d952e expref: 27 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.206858:0:16416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91905c525400) 00010000:00010000:1.0:1788581320.206871:0:16416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581320.206900:0:16416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.206917:0:16416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.206933:0:16416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.206951:0:16416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a71605 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9a4d440 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.206981:0:16416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a71605 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9a4d440 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.206988:0:16416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a71605 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9a4d440 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.207077:0:16416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.207086:0:16416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715fe lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.207092:0:16416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715fe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.207111:0:16416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9600 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581320.207116:0:16416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715fe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.207125:0:16416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715fe lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.207134:0:16416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91905c525700) 00010000:00010000:1.0:1788581320.207137:0:16416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581320.207142:0:16416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715fe lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.207148:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a715fe lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.207158:0:16416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a71605 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9a4d440 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.207171:0:16416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a71605 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9a4d440 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.207178:0:16416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a71605 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9a4d440 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.207183:0:16416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:1.0:1788581320.207186:0:16416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a71605 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9a4d440 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.207193:0:16416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a71605 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9a4d440 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.207201:0:16416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x9a4d440 (ffff91905c6f1d00) 00010000:00010000:1.0:1788581320.207203:0:16416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788581320.207206:0:16416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a71605 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9a4d440 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.207212:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a71605 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9a4d440 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581320.207372:0:16416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+26:14510:x1875462995437184:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 673us (1280us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788581320.207380:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 44 00000100:00100000:1.0:1788581320.211884:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581320.211988:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995437312 00000100:00100000:0.0:1788581320.212002:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995437312 00000100:00100000:0.0:1788581320.212082:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:0.0:1788581320.212191:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+26:14510:x1875462995437312:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788581320.212223:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581320.212286:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ce00/0xf54e3944c2a7160c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9535 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.212335:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7da00/0xf54e3944c2a71613 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.212370:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7da00/0xf54e3944c2a71613 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.212383:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7da00/0xf54e3944c2a71613 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.212635:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7ce00/0xf54e3944c2a7160c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9535 expref: 28 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.212669:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7da00/0xf54e3944c2a71613 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9535 expref: 27 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.212680:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91904995a000) 00010000:00010000:0.0:1788581320.212692:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788581320.212697:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919075b7da00, rc 0) 00000100:00100000:0.0:1788581320.212975:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+27:14510:x1875462995437312:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 881us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581320.212985:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 45 00000100:00100000:3.0:1788581320.220071:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581320.220175:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995437568 00000100:00100000:1.0:1788581320.220189:0:16416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995437568 00000100:00100000:1.0:1788581320.220299:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:1.0:1788581320.220313:0:16416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+27:14510:x1875462995437568:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788581320.220445:0:16416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a7161a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.220467:0:16416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a7161a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.220482:0:16416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a7161a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788581320.220942:0:16416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788581320.220956:0:16416:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 536461711542ns, next at 537461708751ns, rc = 0 00000004:00010000:1.0:1788581320.221075:0:16416:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000415e4e99 reply state 00000000017f0bf4 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a7161a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581320.221087:0:16416:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788581320.221716:0:16416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+29:14510:x1875462995437568:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 1398us (1655us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788581320.221737:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 46 00000100:00100000:3.0:1788581320.225155:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581320.225341:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995437696 00000100:00100000:2.0:1788581320.225355:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995437696 00000100:00100000:2.0:1788581320.225445:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 47 00000100:00100000:2.0:1788581320.225458:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c57f4789-35e1-4272-8645-acd484187c5c+29:14510:x1875462995437696:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581320.225491:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581320.225520:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a71621 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d953c expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.225611:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a71621 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d953c expref: 30 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.225630:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a71621 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d953c expref: 30 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.226484:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91904995a000) 00010000:00010000:2.0:1788581320.226492:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788581320.226498:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91906cb62e00, rc 0) 00000100:00100000:2.0:1788581320.226880:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c57f4789-35e1-4272-8645-acd484187c5c+30:14510:x1875462995437696:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 1421us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581320.226914:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 47 00000100:00100000:3.0:1788581320.229540:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00010000:00010000:2.0:1788581320.229665:0:3324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a7161a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.229680:0:3324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a7161a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.229698:0:3324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a7161a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.229712:0:3324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca8800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:2.0:1788581320.229717:0:3324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a7161a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.229922:0:3324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a7161a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.229948:0:3324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91904995a000) 00010000:00010000:2.0:1788581320.229952:0:3324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788581320.229957:0:3324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a7161a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.229965:0:3324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca8800/0xf54e3944c2a7161a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581320.234230:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995437824 00000100:00100000:1.0:1788581320.234387:0:16415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995437824 00000100:00100000:0.0:1788581320.234720:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:0.0:1788581320.234872:0:16415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c57f4789-35e1-4272-8645-acd484187c5c+5:2374:x1875462995437824:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788581320.235425:0:16415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c57f4789-35e1-4272-8645-acd484187c5c+6:2374:x1875462995437824:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 559us (5896us total) trans 8589934594 rc 0/0 00000100:00080000:1.0:1788581320.235676:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788581320.237914:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581320.238135:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995438080 00000100:00100000:1.0:1788581320.238148:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995438080 00000100:00100000:1.0:1788581320.238219:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:1.0:1788581320.238232:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c57f4789-35e1-4272-8645-acd484187c5c+29:14510:x1875462995438080:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788581320.238574:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c57f4789-35e1-4272-8645-acd484187c5c+30:14510:x1875462995438080:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 343us (674us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788581320.238584:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 9 00000100:00100000:0.0:1788581320.239946:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 12 00000100:00100000:3.0:1788581320.242204:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581320.242370:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995438336 00000100:00100000:0.0:1788581320.242383:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995438336 00000100:00100000:0.0:1788581320.242466:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:0.0:1788581320.242497:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+30:14510:x1875462995438336:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788581320.242644:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+30:14510:x1875462995438336:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 150us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581320.243288:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 48 00000100:00100000:3.0:1788581320.245994:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581320.246191:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995438464 00000100:00100000:1.0:1788581320.246223:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995438464 00000100:00100000:1.0:1788581320.246337:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:1.0:1788581320.246349:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+30:14510:x1875462995438464:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788581320.246375:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581320.246400:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a71628 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d9543 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.246489:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a7162f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.246506:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a7162f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.246519:0:14418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a7162f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788581320.246566:0:14418:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788581320.246586:0:14418:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a7162f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.246614:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a71628 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9543 expref: 32 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.246635:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a7162f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9543 expref: 31 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.246646:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91904995a000) 00010000:00010000:1.0:1788581320.246648:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788581320.246652:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919044ca9600, rc 0) 00000100:00100000:1.0:1788581320.246735:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+31:14510:x1875462995438464:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 388us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581320.246748:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 49 00000100:00100000:3.0:1788581320.249590:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581320.249712:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995438592 00000100:00100000:2.0:1788581320.249733:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995438592 00000100:00100000:2.0:1788581320.249812:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:2.0:1788581320.249824:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c57f4789-35e1-4272-8645-acd484187c5c+6:2375:x1875462995438592:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788581320.249848:0:15100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581320.249894:0:15100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a045ece/0xf54e3944c2a71636 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52cd7c2d4d8d954a expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788581320.249931:0:15100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b95c7, blocks: 0x1 00010000:00010000:2.0:1788581320.249958:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788581320.249964:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581320.249976:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a045ece/0xf54e3944c2a71636 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d954a expref: 7 pid: 15100 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.249997:0:15100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a045ece/0xf54e3944c2a71636 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d954a expref: 7 pid: 15100 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.250013:0:15100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91906cb62600, rc 0) 00000100:00100000:2.0:1788581320.250113:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c57f4789-35e1-4272-8645-acd484187c5c+7:2375:x1875462995438592:12345-192.168.201.13@tcp:101:lhsmtool_posix.0 Request processed in 290us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581320.250121:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:3.0:1788581320.253590:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581320.253729:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995438848 00000100:00100000:1.0:1788581320.253742:0:16416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995438848 00000100:00100000:1.0:1788581320.253819:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:1.0:1788581320.253833:0:16416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+31:14510:x1875462995438848:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788581320.253995:0:16416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+31:14510:x1875462995438848:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 164us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581320.254004:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 50 00000100:00100000:0.0:1788581320.257155:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581320.257308:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995438976 00000100:00100000:1.0:1788581320.257323:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995438976 00000100:00100000:1.0:1788581320.257404:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 51 00000100:00100000:1.0:1788581320.257417:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+31:14510:x1875462995438976:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788581320.299636:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934602 is committed 00000001:00080000:2.0:1788581320.299670:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:2.0:1788581320.299689:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1788581320.299698:0:5899:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788581320.299911:0:5899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788581320.300289:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014299008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788581320.300383:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581320.300557:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014299008 00000100:00100000:1.0:1788581320.300568:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014299008 00000100:00100000:1.0:1788581320.300665:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788581320.300678:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014299008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788581320.301064:0:15099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788581320.301068:0:15099:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788581320.301071:0:15099:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788581320.301072:0:15099:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788581319 -> 1788581319 00002000:00010000:1.0:1788581320.301075:0:15099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788581320.301325:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3341:x1875463014299008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 648us (941us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788581320.301333:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788581320.301399:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581320.301569:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c57f4789-35e1-4272-8645-acd484187c5c+14:14510:x1875462995438976:12345-192.168.201.13@tcp:44:lhsmtool_posix.0 Request processed in 44150us (44424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581320.301580:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 51 00000004:00080000:3.0:1788581320.304570:0:3341:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91907b96fb80/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788581320.304597:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014299008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788581320.305454:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581320.305580:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995439104 00000100:00100000:2.0:1788581320.305591:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995439104 00000100:00100000:2.0:1788581320.305835:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:2.0:1788581320.305849:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c57f4789-35e1-4272-8645-acd484187c5c+7:2375:x1875462995439104:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788581320.306067:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c57f4789-35e1-4272-8645-acd484187c5c+7:2375:x1875462995439104:12345-192.168.201.13@tcp:16:lhsmtool_posix.0 Request processed in 219us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581320.306077:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 15 00000100:00100000:2.0:1788581320.310078:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581320.310960:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995439360 00000100:00100000:1.0:1788581320.310977:0:16416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995439360 00000100:00100000:1.0:1788581320.311070:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 52 00000100:00100000:1.0:1788581320.311084:0:16416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+14:14510:x1875462995439360:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788581320.311602:0:16416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581320.311645:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9600/0xf54e3944c2a7162f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9543 expref: 14 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.311670:0:16416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91904995a000) 00010000:00010000:1.0:1788581320.311676:0:16416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788581320.312027:0:16416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7163d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.312046:0:16416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7163d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.312058:0:16416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7163d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788581320.312570:0:16416:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a8fd912 reply state 00000000dc10b47e transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7163d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581320.312584:0:16416:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788581320.312771:0:16416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c57f4789-35e1-4272-8645-acd484187c5c+15:14510:x1875462995439360:12345-192.168.201.13@tcp:36:lhsmtool_posix.0 Request processed in 1687us (2707us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788581320.312782:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 52 00010000:00010000:3.0:1788581320.316449:0:3325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7163d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.316473:0:3325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7163d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.316482:0:3325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7163d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.316489:0:3325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9800 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:3.0:1788581320.316494:0:3325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7163d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.316503:0:3325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7163d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.316531:0:3325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91904995a000) 00010000:00010000:3.0:1788581320.316535:0:3325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788581320.316540:0:3325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7163d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.316548:0:3325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919044ca9800/0xf54e3944c2a7163d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16416 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581320.318017:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581320.318169:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995439488 00000100:00100000:0.0:1788581320.318184:0:16415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995439488 00000100:00100000:0.0:1788581320.318342:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:0.0:1788581320.318356:0:16415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c57f4789-35e1-4272-8645-acd484187c5c+7:2375:x1875462995439488:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788581320.318661:0:16415:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788581320.318667:0:16415:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788581318 00002000:00010000:0.0:1788581320.318670:0:16415:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788581318 00002000:00010000:0.0:1788581320.318672:0:16415:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788581319 -> 1788581318 00002000:00010000:0.0:1788581320.318675:0:16415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788581320.318948:0:16415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c57f4789-35e1-4272-8645-acd484187c5c+8:2375:x1875462995439488:12345-192.168.201.13@tcp:2:lhsmtool_posix.0 Request processed in 593us (946us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788581320.318958:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 16 00000100:00100000:0.0:1788581320.322082:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581320.322191:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995439616 00000100:00100000:2.0:1788581320.322206:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995439616 00000100:00100000:2.0:1788581320.322311:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:2.0:1788581320.322324:0:15100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c57f4789-35e1-4272-8645-acd484187c5c+8:2374:x1875462995439616:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788581320.322383:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a71644 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.322405:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581320.322410:0:15100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581320.322418:0:15100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a71644 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.322433:0:15100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a71644 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.322471:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a71644 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.322481:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a71644 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.322492:0:15100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a71644 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.322520:0:15100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb63a00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:2.0:1788581320.322526:0:15100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a71644 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.322536:0:15100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a71644 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.322557:0:15100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a71644 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.322566:0:15100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a71644 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581320.322670:0:15100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c57f4789-35e1-4272-8645-acd484187c5c+8:2374:x1875462995439616:12345-192.168.201.13@tcp:1:lhsmtool_posix.0 Request processed in 348us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581320.322678:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:3.0:1788581320.326590:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581320.326809:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995439872 00000100:00100000:2.0:1788581320.326824:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995439872 00000100:00100000:2.0:1788581320.326965:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 53 00000100:00100000:2.0:1788581320.326979:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c57f4789-35e1-4272-8645-acd484187c5c+14:14510:x1875462995439872:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788581320.327105:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a7164b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.327128:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a7164b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.327167:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a7164b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.328924:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a71652 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.328983:0:14417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a71621 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d953c expref: 15 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.328994:0:14417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a71652 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.329053:0:14417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a71621 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d953c expref: 15 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.329074:0:14417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a71621 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d953c expref: 15 pid: 14417 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581320.329095:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43217b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14417:1875463014299136:192.168.201.13@tcp:104: 00000100:00100000:2.0:1788581320.332099:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05540 going to sleep for 11 seconds 00000100:00100000:3.0:1788581320.335674:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581320.342071:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995440000 00000100:00100000:1.0:1788581320.342096:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995440000 00010000:00010000:1.0:1788581320.342174:0:14403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a71621 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d953c expref: 16 pid: 14417 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581320.342266:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 13 00000100:00100000:1.0:1788581320.342279:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c57f4789-35e1-4272-8645-acd484187c5c+16:2374:x1875462995440000:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581320.342300:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581320.342309:0:14403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a71621 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d953c expref: 16 pid: 14417 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.342325:0:14403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a71621 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d953c expref: 16 pid: 14417 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.342356:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91904995a000) 00010000:00010000:1.0:1788581320.342361:0:14403:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a71652 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.342373:0:14403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a71652 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.342382:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a71652 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.342408:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581320.342487:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c57f4789-35e1-4272-8645-acd484187c5c+16:2374:x1875462995440000:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 210us (6831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581320.342496:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 13 00010000:00010000:2.0:1788581320.342894:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb62e00/0xf54e3944c2a71621 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d953c expref: 15 pid: 14417 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581320.342915:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43217b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14417:1875463014299136:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581320.342947:0:14417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a71652 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.342957:0:14417:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a71652 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.342972:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a71652 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581320.343229:0:14417:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788581320.343432:0:14417:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788581320.343480:0:14417:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788581320.343576:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43217b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14417:1875463014299264:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788581320.344971:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581320.345096:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff919046ab1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581320.348448:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014299264 00000100:00100000:1.0:1788581320.348476:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014299264 00000100:00100000:1.0:1788581320.348618:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581320.348633:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14417:x1875463014299264:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788581320.349491:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14417:x1875463014299264:12345-0@lo:1000:mdt00_001.0 Request processed in 859us (5837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581320.349501:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581320.349625:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43217b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14417:1875463014299264:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788581320.350577:0:14417:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788581320.350709:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43217b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14417:1875463014299392:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788581320.350778:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581320.354097:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff919048d7fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581320.361370:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014299392 00000100:00100000:3.0:1788581320.361400:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014299392 00000100:00100000:3.0:1788581320.361518:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581320.361533:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14417:x1875463014299392:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788581320.362850:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14417:x1875463014299392:12345-0@lo:1000:mdt00_001.0 Request processed in 1309us (12061us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788581320.362866:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581320.363041:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43217b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14417:1875463014299392:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788581320.363172:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a71652 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.363188:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a71652 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.363224:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a71652 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.363231:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb63200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581320.363237:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a71652 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.363334:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a71652 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.363358:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91904995a000) 00010000:00010000:0.0:1788581320.363362:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788581320.363369:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a71652 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.363376:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63200/0xf54e3944c2a71652 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.363418:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a715b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.363426:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a715b1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.363432:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a715b1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.363438:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190821ce200 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581320.363440:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a715b1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.363457:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a715b1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.363468:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:0.0:1788581320.363471:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788581320.363479:0:14417:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a715b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9520 expref: 18 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.363493:0:14417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a715b8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9520 expref: 18 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.363504:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a715b8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9520 expref: 18 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.363585:0:14417:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce000/0xf54e3944c2a715b8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d9520 expref: 18 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581320.363604:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907be17480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14417:1875463014299520:192.168.201.13@tcp:105: 00000100:00100000:0.0:1788581320.363837:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff918f4357f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788581320.367217:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581320.368080:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907be17480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14417:1875463014299520:192.168.201.13@tcp:105: 00010000:00010000:0.0:1788581320.368122:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a715b1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368136:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190821ce200/0xf54e3944c2a715b1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368185:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a71659 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368220:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a71659 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368234:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a71659 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368310:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a71659 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368318:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a71659 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368325:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a71659 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368331:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919075b7d400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581320.368335:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a71659 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368343:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a71659 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368358:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:0.0:1788581320.368361:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788581320.368364:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a71659 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368370:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919075b7d400/0xf54e3944c2a71659 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368381:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a7164b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368395:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a7164b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368401:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a7164b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368406:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb63400 already unused, calling callback (ffffffffc21134f0) 00010000:00010000:0.0:1788581320.368409:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a7164b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368415:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a7164b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368425:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919043bfeb00) 00010000:00010000:0.0:1788581320.368427:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788581320.368430:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a7164b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.368437:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91906cb63400/0xf54e3944c2a7164b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581320.368917:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995440128 00000100:00100000:1.0:1788581320.368929:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995440128 00000100:00100000:0.0:1788581320.368956:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c57f4789-35e1-4272-8645-acd484187c5c+19:14510:x1875462995439872:12345-192.168.201.13@tcp:57:lhsmtool_posix.0 Request processed in 41979us (42379us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788581320.368969:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 53 00000020:00080000:0.0:1788581320.368978:0:14417:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788581320.369422:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 10 00000100:00100000:0.0:1788581320.369433:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919042ad9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c57f4789-35e1-4272-8645-acd484187c5c+18:14509:x1875462995440128:12345-192.168.201.13@tcp:49:dd.0 00000100:00100000:0.0:1788581320.369640:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919042ad9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c57f4789-35e1-4272-8645-acd484187c5c+18:14509:x1875462995440128:12345-192.168.201.13@tcp:49:dd.0 Request processed in 208us (2440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581320.369858:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 10 00000040:00080000:2.0:1788581320.370126:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788581320.370132:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788581320.370171:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788581320.370177:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788581320.374225:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581320.374584:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995440384 00000100:00100000:3.0:1788581320.374598:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995440384 00000100:00100000:3.0:1788581320.374728:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 11 00000100:00100000:3.0:1788581320.374743:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f43216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c57f4789-35e1-4272-8645-acd484187c5c+18:14510:x1875462995440384:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788581320.375675:0:14419:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788581320.375993:0:14419:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1788581320.376066:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904dc2ce00/0xf54e3944c2a71660 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.376146:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904dc2ce00/0xf54e3944c2a71660 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.376163:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904dc2ce00/0xf54e3944c2a71660 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.376172:0:14419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904dc2ce00/0xf54e3944c2a71660 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.376187:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904dc2ce00/0xf54e3944c2a71660 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.376195:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904dc2ce00/0xf54e3944c2a71660 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.377042:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581320.377054:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904dc2ce00/0xf54e3944c2a71660 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.377063:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904dc2ce00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581320.377068:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904dc2ce00/0xf54e3944c2a71660 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.377077:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904dc2ce00/0xf54e3944c2a71660 lrc: 5/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.377081:0:14419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788581320.377094:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91904995a000) 00010000:00010000:1.0:1788581320.377098:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788581320.377103:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904dc2ce00/0xf54e3944c2a71660 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.377109:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904dc2ce00/0xf54e3944c2a71660 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.377127:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581320.377129:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581320.377131:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581320.377864:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f43216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c57f4789-35e1-4272-8645-acd484187c5c+20:14510:x1875462995440384:12345-192.168.201.13@tcp:35:lhsmtool_posix.0 Request processed in 3112us (3641us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788581320.377878:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 11 00000020:00080000:2.0:1788581320.377885:0:14419:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788581320.517808:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581320.517865:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581320.517888:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581320.517899:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581320.517911:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581320.518127:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995440512 00000100:00100000:2.0:1788581320.518142:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995440512 00000100:00100000:2.0:1788581320.518274:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995440640 00000100:00100000:2.0:1788581320.518278:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995440640 00000100:00100000:2.0:1788581320.518297:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995440768 00000100:00100000:2.0:1788581320.518300:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995440768 00000100:00100000:2.0:1788581320.518315:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995441024 00000100:00100000:2.0:1788581320.518318:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995441024 00000100:00100000:2.0:1788581320.518330:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995440896 00000100:00100000:2.0:1788581320.518332:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995440896 00000100:00100000:2.0:1788581320.518353:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:2.0:1788581320.518367:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c57f4789-35e1-4272-8645-acd484187c5c+12:2374:x1875462995440512:12345-192.168.201.13@tcp:4:dd.0 00010000:00010000:2.0:1788581320.518418:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c121fb6/0xf54e3944c2a71667 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.518446:0:15105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a045ece/0xf54e3944c2a71636 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d954a expref: 12 pid: 15100 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.518457:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581320.518462:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581320.518467:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c121fb6/0xf54e3944c2a71667 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.518514:0:15105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a045ece/0xf54e3944c2a71636 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d954a expref: 12 pid: 15100 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.518531:0:15105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a045ece/0xf54e3944c2a71636 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d954a expref: 12 pid: 15100 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581320.518551:0:15105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918f43216300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15105:1875463014299648:192.168.201.13@tcp:104: 00000100:00100000:2.0:1788581320.518707:0:15105:0:(client.c:2715:ptlrpc_set_wait()) set ffff919047c05540 going to sleep for 11 seconds 00000100:00100000:3.0:1788581320.529649:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581320.529817:0:15105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918f43216300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15105:1875463014299648:192.168.201.13@tcp:104: 00010000:00010000:2.0:1788581320.529866:0:15105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c121fb6/0xf54e3944c2a71667 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581320.530546:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581320.530606:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:2.0:1788581320.530993:0:15107:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788581320.531006:0:15107:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788581320.531087:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788581320.531123:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995441280 00000100:00100000:0.0:1788581320.531132:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995441280 00000100:00100000:0.0:1788581320.531199:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788581320.531205:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995441152 00000100:00100000:0.0:1788581320.531209:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995441152 00000100:00100000:2.0:1788581320.532551:0:16644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:2.0:1788581320.532573:0:16644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c57f4789-35e1-4272-8645-acd484187c5c+14:2374:x1875462995440640:12345-192.168.201.13@tcp:4:dd.0 00010000:00010000:2.0:1788581320.532641:0:16644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a7166e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.532670:0:16644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581320.534282:0:16644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581320.534302:0:16644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a7166e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.534322:0:16644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a7166e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581320.540548:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:0.0:1788581320.540656:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788581320.540672:0:15106:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1788581320.541038:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995441536 00000100:00100000:0.0:1788581320.541052:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995441536 00000100:00100000:2.0:1788581320.542574:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:2.0:1788581320.542603:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c57f4789-35e1-4272-8645-acd484187c5c+15:2374:x1875462995440768:12345-192.168.201.13@tcp:4:dd.0 00010000:00010000:2.0:1788581320.542661:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fb2f366/0xf54e3944c2a71675 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.542698:0:16645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581320.542713:0:16645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581320.542719:0:16645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fb2f366/0xf54e3944c2a71675 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.542733:0:16645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003fb2f366/0xf54e3944c2a71675 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581320.542994:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995441408 00000100:00100000:1.0:1788581320.543005:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995441408 00010000:00010000:1.0:1788581320.543047:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a045ece/0xf54e3944c2a71636 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d954a expref: 16 pid: 15100 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581320.543124:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 14 00000100:00100000:1.0:1788581320.543132:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c57f4789-35e1-4272-8645-acd484187c5c+16:2372:x1875462995441408:12345-192.168.201.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581320.543147:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581320.543176:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a045ece/0xf54e3944c2a71636 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d954a expref: 16 pid: 15100 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.543193:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a045ece/0xf54e3944c2a71636 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d954a expref: 16 pid: 15100 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.543221:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a045ece/0xf54e3944c2a71636 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.13@tcp remote: 0x52cd7c2d4d8d954a expref: 16 pid: 15100 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.543236:0:14404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581320.543240:0:14404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581320.543271:0:14404:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c121fb6/0xf54e3944c2a71667 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.543282:0:14404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c121fb6/0xf54e3944c2a71667 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.543292:0:14404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581320.543294:0:14404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581320.543299:0:14404:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a7166e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.543320:0:14404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a7166e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.543328:0:14404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581320.543331:0:14404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581320.543334:0:14404:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fb2f366/0xf54e3944c2a71675 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.543342:0:14404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fb2f366/0xf54e3944c2a71675 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.543400:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581320.543479:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c57f4789-35e1-4272-8645-acd484187c5c+15:2372:x1875462995441408:12345-192.168.201.13@tcp:103:ldlm_bl.0 Request processed in 346us (13849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581320.543487:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 14 00010000:00010000:1.0:1788581320.543521:0:15105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c121fb6/0xf54e3944c2a71667 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.543531:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c121fb6/0xf54e3944c2a71667 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.545042:0:16644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a7166e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.545066:0:16644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a7166e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.546751:0:16645:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003fb2f366/0xf54e3944c2a71675 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.546775:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fb2f366/0xf54e3944c2a71675 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788581320.684556:0:15105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:1.0:1788581320.684572:0:15105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788581318 -> 1788581320 00002000:00010000:1.0:1788581320.684575:0:15105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788581318 -> 1788581320 00002000:00010000:1.0:1788581320.684578:0:15105:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:1.0:1788581320.684600:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c121fb6/0xf54e3944c2a71667 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.684636:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c121fb6/0xf54e3944c2a71667 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.684647:0:15105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c121fb6/0xf54e3944c2a71667 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.684655:0:15105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb62e00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581320.684662:0:15105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c121fb6/0xf54e3944c2a71667 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.684684:0:15105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c121fb6/0xf54e3944c2a71667 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.684712:0:15105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c121fb6/0xf54e3944c2a71667 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.684720:0:15105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c121fb6/0xf54e3944c2a71667 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581320.684854:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c57f4789-35e1-4272-8645-acd484187c5c+22:2374:x1875462995440512:12345-192.168.201.13@tcp:4:dd.0 Request processed in 166482us (167055us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788581320.684876:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 0 00000100:00100000:1.0:1788581320.684925:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:1.0:1788581320.684945:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190779cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c57f4789-35e1-4272-8645-acd484187c5c+21:2374:x1875462995441024:12345-192.168.201.13@tcp:4:dd.0 00010000:00010000:1.0:1788581320.684993:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c1cd3c3/0xf54e3944c2a7167c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.685016:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581320.685022:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581320.685031:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c1cd3c3/0xf54e3944c2a7167c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.685047:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c1cd3c3/0xf54e3944c2a7167c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.685991:0:16644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a7166e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.686009:0:16644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a7166e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.686018:0:16644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a7166e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.686026:0:16644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb63a00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:2.0:1788581320.686030:0:16644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a7166e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.686040:0:16644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a7166e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.686070:0:16644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a7166e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.686078:0:16644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004928bd17/0xf54e3944c2a7166e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581320.686222:0:16644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c57f4789-35e1-4272-8645-acd484187c5c+21:2374:x1875462995440640:12345-192.168.201.13@tcp:4:dd.0 Request processed in 153654us (168351us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788581320.686232:0:16644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 1 00000100:00100000:2.0:1788581320.686296:0:16644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:2.0:1788581320.686312:0:16644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c57f4789-35e1-4272-8645-acd484187c5c+20:2374:x1875462995440896:12345-192.168.201.13@tcp:4:dd.0 00010000:00010000:2.0:1788581320.686339:0:16644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f53491d/0xf54e3944c2a71683 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.686352:0:16644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581320.686357:0:16644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788581320.686363:0:16644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f53491d/0xf54e3944c2a71683 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.686374:0:16644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f53491d/0xf54e3944c2a71683 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788581320.687611:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:0.0:1788581320.687638:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1788581320.687657:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:0.0:1788581320.687663:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00010000:00010000:1.0:1788581320.696007:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788581320.731287:0:16645:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:3.0:1788581320.731301:0:16645:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1788581320.731324:0:16645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fb2f366/0xf54e3944c2a71675 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.731341:0:16645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fb2f366/0xf54e3944c2a71675 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.731367:0:16645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fb2f366/0xf54e3944c2a71675 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.731375:0:16645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb63400 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:3.0:1788581320.731381:0:16645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fb2f366/0xf54e3944c2a71675 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.731391:0:16645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fb2f366/0xf54e3944c2a71675 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.731419:0:16645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fb2f366/0xf54e3944c2a71675 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.731428:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fb2f366/0xf54e3944c2a71675 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581320.731575:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c57f4789-35e1-4272-8645-acd484187c5c+18:2374:x1875462995440768:12345-192.168.201.13@tcp:4:dd.0 Request processed in 188976us (213674us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788581320.731594:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 2 00000100:00100000:3.0:1788581320.731635:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 5 00000100:00100000:3.0:1788581320.731662:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c57f4789-35e1-4272-8645-acd484187c5c+17:2374:x1875462995441280:12345-192.168.201.13@tcp:4:dd.0 00010000:00010000:3.0:1788581320.731716:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064b08000/0xf54e3944c2a7168a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.731732:0:16645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581320.731745:0:16645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788581320.731755:0:16645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064b08000/0xf54e3944c2a7168a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581320.731771:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064b08000/0xf54e3944c2a7168a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788581320.732306:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:2.0:1788581320.781265:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:2.0:1788581320.781293:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:0.0:1788581320.784357:0:15105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:0.0:1788581320.784373:0:15105:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:0.0:1788581320.784407:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c1cd3c3/0xf54e3944c2a7167c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.784424:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c1cd3c3/0xf54e3944c2a7167c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.784435:0:15105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c1cd3c3/0xf54e3944c2a7167c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.784442:0:15105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9600 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581320.784449:0:15105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c1cd3c3/0xf54e3944c2a7167c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.784474:0:15105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c1cd3c3/0xf54e3944c2a7167c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.784510:0:15105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c1cd3c3/0xf54e3944c2a7167c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.784519:0:15105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c1cd3c3/0xf54e3944c2a7167c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581320.784657:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190779cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c57f4789-35e1-4272-8645-acd484187c5c+13:2374:x1875462995441024:12345-192.168.201.13@tcp:4:dd.0 Request processed in 99713us (266747us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788581320.784669:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 3 00000100:00100000:0.0:1788581320.784732:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 6 00000100:00100000:0.0:1788581320.784750:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c57f4789-35e1-4272-8645-acd484187c5c+12:2374:x1875462995441152:12345-192.168.201.13@tcp:4:dd.0 00010000:00010000:0.0:1788581320.784797:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0bc09d8/0xf54e3944c2a71691 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.784813:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788581320.784820:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788581320.784829:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0bc09d8/0xf54e3944c2a71691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.784845:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0bc09d8/0xf54e3944c2a71691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.785110:0:16644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f53491d/0xf54e3944c2a71683 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.785131:0:16644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f53491d/0xf54e3944c2a71683 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.785140:0:16644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f53491d/0xf54e3944c2a71683 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.785147:0:16644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91906cb63200 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581320.785152:0:16644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f53491d/0xf54e3944c2a71683 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.785161:0:16644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f53491d/0xf54e3944c2a71683 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.785182:0:16644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f53491d/0xf54e3944c2a71683 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.785201:0:16644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f53491d/0xf54e3944c2a71683 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581320.785333:0:16644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c57f4789-35e1-4272-8645-acd484187c5c+12:2374:x1875462995440896:12345-192.168.201.13@tcp:4:dd.0 Request processed in 99024us (267414us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1788581320.785342:0:16644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 4 00000100:00100000:1.0:1788581320.785376:0:16644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 7 00000100:00100000:1.0:1788581320.785388:0:16644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c57f4789-35e1-4272-8645-acd484187c5c+11:2374:x1875462995441536:12345-192.168.201.13@tcp:4:dd.0 00010000:00010000:1.0:1788581320.785424:0:16644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001710c26c/0xf54e3944c2a71698 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.785437:0:16644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581320.785441:0:16644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788581320.785448:0:16644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001710c26c/0xf54e3944c2a71698 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.785459:0:16644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001710c26c/0xf54e3944c2a71698 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788581320.848614:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:0.0:1788581320.851079:0:16645:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1788581320.851221:0:16645:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1788581320.851260:0:16645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064b08000/0xf54e3944c2a7168a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.851276:0:16645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064b08000/0xf54e3944c2a7168a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.851286:0:16645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064b08000/0xf54e3944c2a7168a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.851292:0:16645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904dc2c200 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:0.0:1788581320.851298:0:16645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064b08000/0xf54e3944c2a7168a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.851309:0:16645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064b08000/0xf54e3944c2a7168a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.851338:0:16645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064b08000/0xf54e3944c2a7168a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581320.851346:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064b08000/0xf54e3944c2a7168a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581320.851534:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c57f4789-35e1-4272-8645-acd484187c5c+13:2374:x1875462995441280:12345-192.168.201.13@tcp:4:dd.0 Request processed in 119882us (320982us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788581320.851563:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 5 00002000:00010000:1.0:1788581320.894033:0:16644:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1788581320.894067:0:16644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001710c26c/0xf54e3944c2a71698 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.894226:0:16644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001710c26c/0xf54e3944c2a71698 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788581320.894354:0:7696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:1.0:1788581320.894466:0:16644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001710c26c/0xf54e3944c2a71698 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.894503:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0bc09d8/0xf54e3944c2a71691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.894512:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0bc09d8/0xf54e3944c2a71691 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.894519:0:15105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0bc09d8/0xf54e3944c2a71691 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.894526:0:15105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919075b7ca00 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:2.0:1788581320.894532:0:15105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0bc09d8/0xf54e3944c2a71691 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.894543:0:15105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0bc09d8/0xf54e3944c2a71691 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.894570:0:15105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0bc09d8/0xf54e3944c2a71691 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581320.894578:0:15105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0bc09d8/0xf54e3944c2a71691 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581320.894865:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c57f4789-35e1-4272-8645-acd484187c5c+7:2374:x1875462995441152:12345-192.168.201.13@tcp:4:dd.0 Request processed in 110113us (364248us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788581320.894878:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 6 00010000:00010000:1.0:1788581320.894939:0:16644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919044ca9400 already unused, calling callback (ffffffffc16d3230) 00010000:00010000:1.0:1788581320.894943:0:16644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001710c26c/0xf54e3944c2a71698 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.894952:0:16644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001710c26c/0xf54e3944c2a71698 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.894963:0:16644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001710c26c/0xf54e3944c2a71698 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581320.894970:0:16644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001710c26c/0xf54e3944c2a71698 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581320.895022:0:16644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c57f4789-35e1-4272-8645-acd484187c5c+5:2374:x1875462995441536:12345-192.168.201.13@tcp:4:dd.0 Request processed in 109637us (354493us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788581320.895030:0:16644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 7 00010000:00010000:1.0:1788581321.711482:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581322.352152:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014299904:0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.352317:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581322.352392:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3339:1875463014300416:0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.352431:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581322.352470:0:3339:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788581322.352476:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3339:1875463014299776:0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.352509:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581322.352534:0:3339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014300288:0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.352557:0:3339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581322.352585:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014300032:0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.352610:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581322.352630:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581322.352635:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014300160:0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.352670:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581322.352721:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014299904 00000100:00100000:3.0:1788581322.352733:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014299904 00000100:00100000:3.0:1788581322.352809:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014300032 00000100:00100000:3.0:1788581322.352812:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014300032 00000100:00100000:3.0:1788581322.352842:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788581322.352869:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014299904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.352934:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3339:x1875463014299904:12345-0@lo:400:kworker.0 Request processed in 68us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581322.352942:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788581322.352964:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788581322.352970:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014300032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.353002:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014300032:12345-0@lo:400:kworker.0 Request processed in 31us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581322.353008:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788581322.353027:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014299776 00000100:00100000:3.0:1788581322.353032:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014299776 00000100:00100000:3.0:1788581322.353060:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788581322.353068:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:3339:x1875463014299776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.353100:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c4ed75f-0e9f-4624-94e3-96119520d4d4+19:3339:x1875463014299776:12345-0@lo:400:kworker.0 Request processed in 33us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581322.353108:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788581322.353143:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014300416 00000100:00100000:3.0:1788581322.353148:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014300416 00000100:00100000:3.0:1788581322.353178:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014300288 00000100:00100000:3.0:1788581322.353182:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014300288 00000100:00100000:3.0:1788581322.353194:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014300160 00000100:00100000:3.0:1788581322.353196:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014300160 00000100:00100000:3.0:1788581322.353209:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788581322.353216:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3339:x1875463014300416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.353285:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3339:x1875463014300416:12345-0@lo:400:kworker.0 Request processed in 69us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581322.353294:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788581322.353315:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788581322.353321:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014300288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.353350:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3339:x1875463014300288:12345-0@lo:400:kworker.0 Request processed in 29us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581322.353356:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788581322.353367:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788581322.353373:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014300160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.353397:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3340:x1875463014300160:12345-0@lo:400:kworker.0 Request processed in 25us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581322.353402:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788581322.353426:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581322.353431:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581322.353434:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581322.353480:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3340:1875463014300160:0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.353493:0:3340:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1788581322.353499:0:3340:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91907b96fb80, transno 8589934595 00000004:00080000:3.0:1788581322.353513:0:3340:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1788581322.353538:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014300032:0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.354147:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c4ed75f-0e9f-4624-94e3-96119520d4d4:3339:1875463014299776:0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.354162:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3339:1875463014300288:0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.354175:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3339:1875463014299904:0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.354187:0:3339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3339:1875463014300416:0@lo:400:kworker.0 00000100:00100000:3.0:1788581322.359039:0:3341:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581322.359078:0:3341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff919076885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014300544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788581322.359187:0:3341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581322.359279:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014300544 00000100:00100000:3.0:1788581322.359289:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014300544 00000100:00100000:3.0:1788581322.359353:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788581322.359363:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014300544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788581322.359411:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788581322.359465:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3341:x1875463014300544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581322.359473:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788581322.359534:0:3341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff919076885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3341:1875463014300544:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788581322.521672:0:16684:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1788581322.631955:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581322.632198:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581322.632232:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581322.632281:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581322.632301:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581322.632342:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:1.0:1788581322.632377:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.13@tcp (source: 12345-192.168.201.13@tcp) 00000100:00100000:3.0:1788581322.632528:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995441664 00000100:00100000:3.0:1788581322.632542:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995441664 00000100:00100000:3.0:1788581322.632606:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 123 00000100:00100000:3.0:1788581322.632617:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919075b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:2374:x1875462995441664:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581322.632723:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919075b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:04cbc643-64a0-4a77-9b56-cef82e5dcfcc+13:2374:x1875462995441664:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 107us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581322.632731:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 123 00000100:00100000:3.0:1788581322.632767:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995442176 00000100:00100000:3.0:1788581322.632771:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995442176 00000100:00100000:3.0:1788581322.632809:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995441792 00000100:00100000:3.0:1788581322.632812:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995441792 00000100:00100000:3.0:1788581322.632832:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:3.0:1788581322.632838:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:2374:x1875462995442176:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581322.632878:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b18916b8-1f25-41d8-9a9b-e15210a2edd6+6:2374:x1875462995442176:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 40us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581322.632884:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 27 00000100:00100000:3.0:1788581322.632917:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 28 00000100:00100000:3.0:1788581322.632923:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+20:2374:x1875462995441792:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581322.632952:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c57f4789-35e1-4272-8645-acd484187c5c+20:2374:x1875462995441792:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 29us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581322.632958:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 28 00000100:00100000:3.0:1788581322.632990:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995441920 00000100:00100000:3.0:1788581322.632994:0:16415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995441920 00000100:00100000:3.0:1788581322.633017:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995442432 00000100:00100000:3.0:1788581322.633019:0:16415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995442432 00000100:00100000:3.0:1788581322.633033:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995442048 00000100:00100000:3.0:1788581322.633035:0:16415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995442048 00000100:00100000:3.0:1788581322.633050:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875462995442304 00000100:00100000:3.0:1788581322.633052:0:16415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875462995442304 00000100:00100000:3.0:1788581322.633068:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:3.0:1788581322.633074:0:16415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c57f4789-35e1-4272-8645-acd484187c5c+5:2374:x1875462995441920:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581322.633172:0:16415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c57f4789-35e1-4272-8645-acd484187c5c+5:2374:x1875462995441920:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 97us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581322.633178:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 17 00000100:00100000:3.0:1788581322.633190:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:3.0:1788581322.633196:0:16415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b18916b8-1f25-41d8-9a9b-e15210a2edd6+5:2374:x1875462995442432:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581322.633221:0:16415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b18916b8-1f25-41d8-9a9b-e15210a2edd6+5:2374:x1875462995442432:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 26us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581322.633226:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 18 00000100:00100000:3.0:1788581322.633236:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:3.0:1788581322.633261:0:16415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c57f4789-35e1-4272-8645-acd484187c5c+5:2374:x1875462995442048:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581322.633285:0:16415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c57f4789-35e1-4272-8645-acd484187c5c+5:2374:x1875462995442048:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 44us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581322.633298:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 19 00000100:00100000:3.0:1788581322.633310:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00100000:3.0:1788581322.633316:0:16415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b18916b8-1f25-41d8-9a9b-e15210a2edd6+5:2374:x1875462995442304:12345-192.168.201.13@tcp:400:kworker.0 00000100:00100000:3.0:1788581322.633341:0:16415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b18916b8-1f25-41d8-9a9b-e15210a2edd6+5:2374:x1875462995442304:12345-192.168.201.13@tcp:400:kworker.0 Request processed in 25us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581322.633346:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.13@tcp, seq: 20 00000100:00080000:3.0:1788581322.633374:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581322.633378:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581322.633381:0:14413:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788581322.736428:0:14406:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581323.375695:0:3340:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581323.375721:0:3340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91907b96c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014300672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581323.375803:0:3340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581323.375906:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875463014300672 00000100:00100000:1.0:1788581323.375917:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875463014300672 00000100:00100000:1.0:1788581323.376005:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581323.376016:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b96d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014300672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788581323.376055:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581323.376108:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b96d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3340:x1875463014300672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581323.376117:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581323.376194:0:3340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91907b96c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3340:1875463014300672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788581323.760012:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29970 lines, 29970 kept, 0 dropped, 0 bad.